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Examining  the  performance  of  first-year  classroom 
teachers  may  be  a  useful  way  to  determine  the  effects  of 
teacher  preparation  on  those  teachers'  abilities  to  meet  the 
demands  of  their  profession.   This  study  is  an  examination  of 
effects  of  teacher  preparation  on  the  classroom  performance 
of  beginning  teachers  in  general  and  special  education. 
Several  key  aspects  of  classroom  performance  were  examined: 
(a)  organizing  content  knowledge  for  student  learning,  (b) 
creating  an  environment  for  student  learning,  (c)  teaching 
for  student  learning,  and  (d)  teacher  professionalism. 

Assessments  using  Praxis  III:   Classroom  Performance 
Assessment  were  conducted  on  beginning  teachers  in  special 
education  (N=25)  and  general  education  (N=22) .   Each 
assessment  cycle  consisted  of  a  preobservation  interview,  an 


observation,  and  a  postobservation  interview.   Each  teacher 
was  scored  on  the  19  criteria  of  Praxis  III. 

A  multivariate  analysis  of  variance  (MANOVA)  revealed  a 
significant  difference  between  general  and  special  education 
teachers.   One-way  analyses  of  variance  (ANOVAs)  were 
conducted  for  each  criterion.   Significant  differences 
between  general  education  and  special  education  teachers  were 
detected  on  a  total  of  5  criteria  on  Praxis  III.   General 
educators  scored  significantly  higher  on  measures  of  a 
teachers'  ability  (a)  to  demonstrate  an  understanding  of  the 
connection  between  the  content  that  was  learned  previously, 
the  current  content,  and  the  content  that  remains  to  be 
learned  in  the  future,  (b)  to  encourage  students  to  extend 
their  thinking,  and  (c)  to  build  professional  relationships 
with  colleagues  to  share  teaching  insights  and  to  coordinate 
learning  activities  for  students.   Special  educators  scored 
significantly  higher  on  criterion  related  to  the  creation  of 
a  climate  that  promotes  fairness  and  to  establishing  and 
maintaining  consistent  standards  of  classroom  behavior. 

Several  implications  for  beginning  teaching  research  and 
teacher  preparation  emerge  from  these  findings.   This 
approach  to  beginning  teacher  assessment  promotes  the 
formation  of  a  more  complete  picture  of  teaching  and  learning 
in  context.   The  emergence  of  research  on  the  differences 
between  beginning  general  and  special  education  teachers  may 
be  especially  useful  to  teacher  educators  as  they  could 


IX 


revise  programs  to  better  prepare  preservice  teachers  for  the 
demands  of  their  classrooms . 


CHAPTER  I 
INTRODUCTION  TO  THE  PROBLEM 

Statement  of  the  Problem 

Changes  in  society  are  reflected  in  schools  today.   The 
demands  of  classroom  teaching  are  different  from  what  they 
were  even  a  few  years  ago.   A  clear  understanding  of  the 
demands  of  the  teaching  profession  should  drive  the 
development  and  refinement  of  teacher  preparation  programs . 

Since  the  passage  of  Public  Law  94-142  (Education  of  the 
Handicapped  Act)  in  197  5,  schools  have  been  charged  with  the 
mission  of  educating  all  children  and  youth  equitably. 
Recent  trends  in  the  education  of  students  with  mild  learning 
and  behavior  problems  have  prompted  an  increase  in 
collaborative  efforts  between  general  and  special  education 
teachers  (Goodlad  &  Lovitt,  1993;  Pugach  &  Johnson,  1989). 
This  type  of  collaboration,  however,  requires  the  joining  of 
groups  of  professionals  who  have  differences  in  professional 
knowledge  structures  due  to  the  distinctive  orientations  of 
general  and  special  education  teacher  preparation  (Sindelar, 
et  al . ,  1995).   Traditionally,  general  education  preparation 
has  focused  on  pedagogical  and  curricular  concerns.   In 
contrast,  special  education  preparation  has  emphasized 
instructional  strategies,  individualized  instruction,  and 
behavior  management .   A  greater  understanding  of  the 
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similarities  and  differences  between  the  demands  of  teaching 
in  general  and  special  education  has  implications  for  teacher 
education  programs . 

Information  that  could  lead  to  a  clearer  understanding 
of  the  demands  of  teaching  in  general  and  special  education 
could  come  from  a  variety  of  sources .   One  source  of 
information  would  be  the  classroom  performance  of  teachers  in 
general  and  special  education.   Examining  the  performance  of 
first-year  classroom  teachers  may  be  a  useful  way  to 
determine  the  effects  of  teacher  preparation  on  those 
teachers'  abilities  to  meet  the  demands  of  their  profession. 
Very  little  research  has  examined  the  effects  of  teacher 
preparation  on  teacher  performance. 

Research  emerging  from  teacher  development  theory  has 
provided  a  foundation  for  understanding  teacher  concerns  at 
the  initial  stages  of  development.   At  least  two  limitations 
of  this  research  are  evident:   (a)  the  research  has  been 
conducted  primarily  with  general  education  teachers  and  (b) 
the  effects  of  teacher  preparation  on  teacher  development 
have  received  little  attention.   Teacher  concerns  at  the 
initial  stages  of  teacher  development  may  be  different  for 
the  two  groups  of  teachers  due  to  the  differences  in  teacher 
preparation. 

Rationale  for  the  Study 

This  study  examines  how  differences  in  general  and 
special  education  teacher  preparation  programs  affect  the 
ability  of  teachers  to  meet  the  demands  of  their  classrooms. 


The  central  purpose  of  the  study  was  to  compare  the  effects 
of  teacher  preparation  on  the  classroom  performance  of 
beginning  teachers  in  general  and  special  education.   Several 
aspects  of  beginning  teachers'  classroom  performance  were 
examined:   (a)  organizing  content  knowledge  for  student 
learning,  (b)  creating  an  environment  for  student  learning, 
(c)  teaching  for  student  learning,  and  (d)  teacher 
professionalism. 

Scope  of  the  Study 

This  study  was  conducted  within  a  limited  scope.   The 
delimitations  and  limitations  of  this  research  are  described 
in  the  following  sections. 
Delimitations 

This  study  was  delimited  by  geographical  location  to 
districts  within  the  state  of  Florida.   The  research 
participants  were  47  first-year  teachers  who  had  graduated 
from  a  teacher  preparation  program  at  one  of  four  state 
universities  in  Florida.   Participant  selection  did  not 
include  consideration  of  graduates  of  the  other  five  state 
universities.   Additionally,  several  districts  were 
eliminated  from  the  sample  pool  due  to  the  time  and  expense 
required  to  travel  to  them. 
Limitations 

This  study  was  conducted  with  beginning  general  and 
special  education  teachers  during  the  second  semester  of 
their  first  year  of  teaching.   The  teachers'  beliefs,  skills, 
and  knowledge  prior  to  entering  a  teacher  preparation  program 


were  unknown  and  may  have  influenced  the  results  of  this 
study.   The  nature  of  voluntary  participation  by  the  teachers 
may  further  limit  this  study.   In  addition,  differences  in 
teacher  preparation  programs  were  not  assessed. 
Consequently,  differences  between  special  and  general 
education  teachers  may  or  may  not  have  been  attributable  to 
differences  in  specific  university  programs.   Finally,  the 
results  of  this  study  may  not  be  generalized  to  teachers  of 
middle  and  high  school  students  or  teachers  who  graduated 
from  unified  teacher  preparation  programs. 
Definition  of  Terms 

An  understanding  of  the  literature  and  procedures 
discussed  in  this  study  requires  a  clarification  of 
terminology.   The  terms  defined  in  this  section  are  needed 
for  interpretation  of  this  study. 

Teacher  assessment  and  teacher  evaluation  refer  to  a 
multifaceted  process  that  considers  the  way  a  teacher 
performs  a  variety  of  tasks  within  a  context,  the  meaning  of 
their  performance  in  terms  of  that  context,  and  often  a 
likely  explanation  for  those  performances.   These  terms  will 
be  used  interchangeably  for  the  purposes  of  this  study. 

Beginning  teacher  and  first-vear  teacher  describe  an 
individual  who  is  currently  in  the  first  year  of  teaching. 

Experienced  teacher  is  an  individual  who  has  typically 
taught  more  than  one  year  but  does  not  necessarily  imply  that 
the  teacher  is  competent. 


Teacher  competence  is  the  repertoire  of  competencies  a 
teacher  possesses.   As  a  teacher  comes  to  possess  more 
competencies,  it  is  said  the  teacher  has  become  more 
competent  (Madaus  &  Mehrens,  1990)  . 

Teacher  competency  is  any  single  knowledge,  skills,  or 
value  position.   The  possession  of  these  competencies  is 
believed  to  be  related  to  teacher  effectiveness. 
Competencies  refer  to  specific  knowledge,  behaviors,  and 
beliefs  but  not  to  the  effects  of  these  attributes  on 
students  (Madaus  &  Mehrens,  1990). 

Teacher  effectiveness  is  the  effect  that  the  teacher's 
performance  has  on  pupils.   Teacher  effectiveness  depends  not 
only  on  competence  and  performance,  but  also  on  the  responses 
pupils  make.   Effectiveness  is  defined  in  terms  of  the  scores 
the  teachers'  students  achieve  on  tests  or  similar  measures. 
Just  as  competence  cannot  predict  performance  cannot  predict 
outcomes  under  different  situations  (Madaus  &  Mehrens,  1990) . 

Teacher  performance  refers  to  the  actual  behavior  of  the 
teacher  while  teaching.   Teacher  performance  is  specific  to 
the  job  situation;  it  depends  on  the  competence  of  the 
teacher,  the  context  in  which  the  teacher  works,  and  the 
teacher's  ability  to  apply  his  or  her  competencies  at  any 
given  point  in  time  (Madaus  &  Mehrens,  1990) . 

Teacher  preparation  program  and  teacher  education 
program  are  university  programs  designed  with  legal 
authorization  to  prepare  teachers.   These  terms  will  be  used 
interchangeably  for  the  purposes  of  this  study. 
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Overview 
An  investigation  of  the  effects  of  teacher  preparation 
(special  and  general  education)  on  beginning  teachers' 
classroom  performance  is  the  focus  of  this  study.   Chapter  II 
provides  a  review  and  analysis  of  relevant  professional 
literature  in  the  areas  of  teacher  preparation,  beginning 
teaching,  teacher  development  theory,  teacher  evaluation,  and 
Praxis  III.   Chapter  III  presents  a  description  of  the 
methods  and  procedures  used  in  this  study.   The  results 
obtained  from  the  Praxis  III  assessments  are  discussed  in 
Chapter  IV.   Chapter  V  includes  (a)  a  discussion  of  the 
results  as  they  relate  to  previous  research,  (b)  implications 
for  teacher  development  theory,  beginning  teaching  knowledge 
base,  and  teacher  education,  (c)  limitations  of  the  research, 
and  (d)  recommendations  for  future  research. 


CHAPTER  II 
REVIEW  OF  RELATED  LITERATURE 

Chapter  II  includes  a  summary  and  analysis  of  the 
literature  on  teacher  preparation,  beginning  teaching, 
teacher  development  theory,  teacher  evaluation,  and  Praxis 
III.   The  chapter  concludes  with  a  summary  of  the  research 
findings. 

Teacher  Preparation 
Differences  in  Preparation 

Pugach  (1992)  proposed  that  special  educators  and 
elementary  educators  historically  have  held  different 
assumptions  about  teaching,  learning,  and  teacher  and  student 
roles.   She  added  that  basic  organizing  structures  and 
beliefs  governing  the  two  programs  remain  distinctly 
different . 

The  origins  of  special  education  were  closely  tied  to 
psychology,  in  particular  behavioral  psychology.   Through 
this  association,  special  education  has  established  a  firm 
foundation  in  positivistic,  behavioral  approaches  (Sindelar 
et  al.,  1995).   These  approaches  emphasize  skill-based 
instruction,  rather  than  holistic  instruction.   Tasks  are 
broken  into  small  units  that  are  taught  in  isolation  and 
reformed  to  create  a  whole.   Teacher  educators  of  special 
education  have  traditionally  prepared  teachers  to  focus  on 
student  competencies  within  categories  of  disability.   The 
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content  of  special  education  courses  has  emphasized  almost 
exclusively  the  individual  and  individual  pathology. 
Although  general  and  special  education  teacher  preparation 
programs  tend  to  address  the  same  content  and  readings,  which 
adds  coherence  to  the  curricula,  special  education  programs 
seldom  address  curriculum  beyond  the  teaching  of  reading  and 
basic  mathematics  (Goodlad  &  Lovitt,  1993).   In  addition, 
through  a  comprehensive  study  of  teacher  education,  Goodlad 
(1993)  found  that  students  in  special  education  teacher 
education  programs  expressed  more  confidence  in  their 
abilities  in  individualized  instruction  and  behavior 
management . 

Conversely,  teacher  educators  in  general  education 
traditionally  have  emphasized  group  process,  rather  than 
individual  student  needs.   Students  in  general  education 
teacher  education  programs  perceived  themselves  as  ill 
equipped  to  deal  with  children  with  disabilities, 
particularly  in  areas  of  individualized  instruction  and 
behavior  management  (Goodlad,  1993).   Preparation  in  general 
education  focuses  on  the  scope  and  sequence  of  curriculum, 
and  more  recently,  holistic  approaches  to  teaching  and 
learning.   Traditionally,  general  education  teacher 
preparation  programs  have  emphasized  instructional  methods 
that  can  be  described  as  implicit.   These  methods  include 
child-determined  exploration,  discovery  learning,  and 
procedural  knowledge  instruction  (Swanson  &  Cooney,  1991)  . 
In  contrast,  special  education  teacher  preparation  programs 


have  emphasized  explicit  methods  of  instruction.   These 
methods  of  instruction  include  direction  instruction 
(Carnine,  Silbert,  &  Kameenui,  1990;  Engelmann,  Carnine,  & 
Steely,  1991;  Gersten,  Carnine,  &  Woodward,  1987),  learning 
strategies  (Schumaker  &  Deshler,  1992;  Swanson,  1989), 
classwide  peer  tutoring  (Greenwood,  Delquadri,  &  Hall,  1989; 
Maheady,  1991),  and  declarative  knowledge  instruction 
(Swanson  &  Cooney,  1991)  . 
Differences  Between  Teachers 

Researchers  have  long  recognized  the  differences  between 
general  education  and  special  education  teacher  preparation; 
however,  they  have  neglected  the  role  of  differences  in 
teacher  education  programs  in  the  development  of  teacher 
differences.   Little  is  known  about  the  knowledge  possessed 
by  general  and  special  education  teachers  about  instruction, 
especially  for  diverse  learners.   Blanton,  Blanton,  and  Cross 
(1994)  conducted  one  of  the  first  studies  to  investigate 
similarities  and  differences  between  general  and  special 
education  teachers  in  how  they  think  and  make  instructional 
decisions.   They  reported  that  general  and  special  education 
teachers  responded  similarly  when  they  identified  student 
strengths  and  the  strategies  they  would  use  to  provide 
instruction.   Yet  the  two  groups  of  teachers  differed  in 
their  explanation  of  why  they  would  use  the  strategy  and 
their  roles  in  working  with  the  student .   Blanton  et  al . 
suggested  that  special  education  teachers  may  possess  a  more 
complex  organization  of  knowledge  from  which  they  interpret 
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learning  problems.   This  expanded  knowledge  base  may  allow 
special  education  teachers  to  better  identify  and  interpret 
problems . 

The  differences  in  the  instructional  practices  of 
general  and  special  education  teachers  appears  to  be  based  on 
the  differences  in  teacher  preparation.   Very  little  research 
has  examined  the  effects  of  teacher  preparation  on  teacher 
performance.   This  study  examines  how  different  program 
philosophies  and  orientations  (i.e.,  general  education  and 
special  education)  affect  the  performance  profiles  of  program 
graduates . 

Beginning  Teacher  Literature 

Sound  assessments  for  beginning  teachers  must  be 
grounded  in  the  research  on  teaching  (Reynolds,  1992).   By 
documenting  what  is  known  about  effective  teachers  and 
particularly  beginning  teachers,  assessment  developers  can 
begin  to  specify  what  aspects  of  teaching  should  be 
addressed.   A  review  of  the  literature  should  be  helpful  in 
addressing  the  following  questions.   What  is  competent 
beginning  teaching?   What  should  we  expect  beginning  teachers 
to  be  able  to  do?   Is  the  knowledge  base  of  beginning 
teachers  different  from  experienced  teachers?   Should 
assessments  for  beginning  teachers  and  experienced  teachers 
differ? 

Educational  research  uses  a  number  of  different  methods 
of  inquiry.   These  different  ways  of  studying  teaching  can 
contribute  to  the  definition  of  competent  beginning  teaching 
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(Fenstermacher,  1986)  .   Therefore,  the  literature  for  this 
section  represents  major  research  programs  that  provide  the 
bulk  of  research  on  teaching  (Shulman,  1986).   These  research 
programs  include  process-product  research,  time  and  learning, 
pupil  cognition  and  the  mediation  of  teaching,  classroom 
ecology,  teacher  cognition  and  decision  making,  and  types  of 
knowledge  (Wittrock,  1986)  . 
Relevant  Literature 

Regardless  of  subject-matter,  grade  level,  or 
instructional  method,  teaching  tasks  can  be  divided  into 
three  broad  domains:   preactive,  interactive,  and  postactive 
(Reynolds,  1992).   Jackson  (1968)  identified  preactive  tasks 
as  that  phase  of  teaching  in  which  the  teacher  develops  an 
appropriate  lesson  plan  or  strategy  and  also  sets  objectives 
for  the  lesson.   Jackson  called  the  implementation  of  this 
lesson  and  objectives  the  interactive  phase  of  teaching. 
Postactive  tasks  include  reflections  after  a  teaching  episode 
as  well  as  steps  to  improve  teaching  (Clark  &  Peterson, 
1986).   Although  these  domains  are  distinct,  the  tasks 
included  may  occur  simultaneously  or  sequentially.   The  rest 
of  this  section  draws  from  a  comprehensive  analysis  of 
reviews  of  effective  teaching  and  studies  of  learning  to 
teach,  regardless  of  the  teaching  context  (i.e.,  grade  level, 
subject  matter) . 

Preactive.   Research  involving  preactive  teaching  tasks 
are  typically  descriptive  in  nature  and  focus  on  lesson  or 
strategy  planning.   Methods  of  inquiry  in  the  thought 
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processes  of  a  teacher  may  include  thinking  aloud,  stimulated 
recall,  and  journal  keeping  (Clark  &  Peterson,  1986).   There 
are  key  differences  in  the  preactive  tasks  of  beginning  and 
more  experienced  teachers.   When  planning  a  lesson,  more 
experienced  teachers  relate  new  information  to  students  in  a 
way  that  connects  to  what  their  students  already  know  (Porter 
&  Brophy,  1988).   Experienced  teachers'  instruction  of  new 
information  is  frequently  integrated  across  content  areas 
(Porter  &  Brophy,  1988).   Experienced  teachers  also  choose 
activities  that  take  into  consideration  their  students' 
developmental  levels,  achievement  levels,  interests,  and 
background  experience  (Brophy  &  Good,  1986;  Christenson, 
Ysseldyke,  &  Thurlow,  1989;  Corno  &  Snow,  1986).   Becoming 
familiar  with  students  allows  experienced  teachers  to  set 
appropriate  expectations  and  clear  learning  goals  (Brophy  & 
Good,  1986;  Peterson,  Marx,  &  Clark,  1978) .   Similarly,  these 
teachers  set  appropriate  expectations  for  themselves  and 
believe  that  they  can  affect  the  learning  of  students; 
whereas  beginning  teachers  question  their  impact  on  student 
achievement  (Brookhart  &  Freeman,  1992). 

Most  teacher  planning  involves  the  use  of  curricular 
materials .  Competent  teachers  select  curricular  materials 
that  are  appropriate  for  the  students'  level  and  needs  as 
well  as  their  interests.  Typically,  experienced  teachers 
take  advantage  of  available  materials  and  spend  more  time  on 
enriching  the  content  (Porter  &  Brophy,  1988)  .  Beginning 
teachers  have  difficulty  with  the  connection  between 
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curricular  material  and  instruction  (Clark  &  Peterson,  1986). 
Effective  teachers  are  more  consistent  with  evaluation  of 
student  progress  than  beginning  teachers  (Porter  &  Brophy, 
1988;  Zigmond,  Sansone,  Miller,  Donahoe,  &  Kohnke,  1986)  . 

One  major  influence  on  teachers'  preactive  tasks  is  the 
knowledge  of  their  students.   Experienced  teachers  give  more 
consideration  to  a  student's  prior  knowledge  of  subject  and 
academic  performance  than  do  beginning  teachers  (Corno  & 
Snow,  1986;  Fogarty,  Wang,  &  Creek,  1983;  Shulman,  1989). 
Beginning  teachers  are  more  impractical  about  student 
differences  and  view  these  differences  as  problematic 
(Carter,  Cushing,  Sabers,  Stein,  &  Berliner,  1988;  Fogarty, 
Wang,  &  Creek,  1983;  Shulman,  1989). 

In  summary,  the  knowledge  of  subject-matter  and  students 
underlies  good  planning.   Experienced  and  beginning  teachers 
appear  to  differ  in  the  depth  of  these  types  of  knowledge. 
Beginning  teachers  are  less  apt  to  consider  subject-matter 
and  student  differences  in  their  planning. 

Interactive.   Most  of  the  research  on  teaching  entails 
interactive  teaching  tasks,  rather  than  preactive  or 
postactive  ones.   This  is  largely  due  to  the  popularity  of 
classroom  observations  as  a  source  of  assessment.   The 
interactive  domain  of  teaching  is  the  actual  implementation 
of  a  lesson  or  strategy.   During  this  time,  the  teacher  is 
actively  engaged  with  the  students  and  content.   Interactive 
teaching  tasks  consists  of  (a)  creating /managing  the  learning 
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environment,  (b)  presenting  subject  matter,  and  (c) 
evaluating  student  learning  (Reynolds,  1992). 

When  creating  an  environment  for  student  learning, 
competent  teachers  view  themselves  as  classroom  managers 
(Brophy  &  Good,  1986).   They  possess  positive  qualities  such 
as  withitness,  empathy,  and  rapport  (Brophy  &  Good,  1986). 
As  a  classroom  manager,  the  competent  teacher  establishes  and 
maintains  consistent  rules  and  routines  (Doyle,  1986;  Brophy 
&  Good,  1986;  Zigmond  et  al . ,  1986).   In  matters  of 
discipline,  competent  teachers  ignore  minor  misbehavior  and 
deal  with  severe  disruptions  through  a  variety  of  means. 
Conversely,  beginning  teachers  generally  have  difficulty  with 
discipline  and  maintaining  consistent  standards  of  behavior 
(Doyle,  1986) .   Researchers  reason  that  beginning  teachers 
spend  time  primarily  on  solving  problems,  whereas  competent 
teachers  define  the  problem  and  evaluate  possible  solutions 
(Reynolds,  1992).   When  determining  the  best  instructional 
arrangement  (e.g.,  small  group,  peer  tutoring,  individualized 
instruction) ,  competent  teachers  base  their  decision  on  how 
best  to  accomplish  the  goals  of  the  lesson  (Doyle,  1986; 
Reynolds,  1992).   Beginning  teachers  have  difficulty  in  their 
selection  of  instructional  grouping  for  given  goals  and 
students.   Moreover,  beginning  teachers  seem  unable  to 
ascertain  what  makes  a  lesson  efficient. 

The  successful  presentation  of  subject  matter  relies  on 
the  quality  of  a  teacher's  subject-matter  knowledge  and 
pedagogical -content  knowledge  (Shulman,  1987).   Beginning 
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teachers  often  have  low  levels  of  pedagogical-content 
knowledge  (Grossman,  1990;  Shulman,  1987)  .   Competent 
teachers  use  their  pedagogical -content  knowledge  to  assess 
the  readiness  of  their  students  before  beginning  new  subject 
matter.   They  focus  on  their  students'  preconceptions  and 
misconceptions.   In  turn,  competent  teachers  use  this 
information  to  adapt  the  level  and  pace  of  instruction 
(Christenson,  Ysseldyke,  &  Thurlow,  1987) .   Further, 
experienced  teachers  vary  their  teaching  strategies  in 
response  to  the  ability  levels  of  students  more  than 
beginning  teachers  (Corno  &  Snow,  1986). 

The  lessons  of  competent  teachers  typically  have  common 
characteristics,  including  clear  expectations,  appropriate 
pacing,  new  learning  related  to  prior  learning,  maintained 
flow  of  activity,  frequent  monitoring  of  performance,  and 
feedback  (Brophy  &  Good,  1986;  Gersten,  Carnine,  &  Woodward, 
1987;  Zigmond  et  al . ,  1986).   Beginning  teachers  may  not 
demonstrate  this  consistency  in  their  instructional  routines 
because  routines  are  not  yet  developed  (Reynolds,  1992). 
Competent  teachers  use  certain  aspects  to  actively  engage 
students  in  lessons,  which  include  orientation  to  the  lesson, 
guided  practice,  development  of  metacognitive  strategies,  and 
effective  questioning  techniques  (Gersten,  Carnine,  & 
Woodward,  1987;  Porter  &  Brophy,  1988;  Swanson,  1989;  Zigmond 
et  al.,  1986).   When  beginning  teachers  respond  to  students 
experiencing  difficulty  in  a  lesson  they  generally  do  not 
link  the  concept  to  related  concepts  (Borko  &  Livingston, 
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1989).   They  are  also  less  effective  in  questioning 
strategies  and  tend  not  to  use  this  information  to  improve 
their  teaching  (Reynolds,  1992). 

Competent  teachers  maintain  consistent  procedures  for 
monitoring  student  progress  and  have  interventions  to  improve 
student  learning.   They  hold  students  accountable  for 
assignments  and  give  clear  expectations  (Christenson, 
Ysseldyke,  &  Thurlow,  1987;  Porter  &  Brophy,  1988)  .   When 
evaluating  student  work,  competent  teachers  look  for 
completeness  and  accuracy,  give  feedback  promptly,  and 
encourage  self  monitoring  (Zigmond  et  al . ,  1986).   In 
addition,  multiple  forms  of  assessment  are  used  to  evaluate 
their  students. 

Postactive .   Competent  teachers  reflect  on  their  own 
teaching  as  well  as  student  responses  (Porter  &  Brophy,  1988; 
Schon,  1987).   They  use  multiple  forms  of  assessment  to  help 
improve  their  teaching.   The  major  distinction  between 
beginning  and  expert  teachers  is  that  novice  teachers' 
reflections  are  less  focused  than  expert  teachers' 
reflections  (Borko  &  Livingston,  1989) .   Beginning  teachers 
highlight  events  during  the  lesson  such  as  their  clarity  of 
examples  used  in  the  presentation  or  student  participation; 
whereas  expert  teachers  target  student  understanding  and 
rarely  mention  their  own  effectiveness  (Reynolds,  1992). 
Little  evidence  is  available  on  the  connection  between 
competent  teaching  and  other  postactive  teaching  tasks,  which 
include  interaction  with  colleagues,  affiliation  with 
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organizations,  enrollment  in  courses,  and  participation  in 
school  activities  (Reynolds,  1992). 
Limitations  of  Existing  Research 

Regardless  of  the  method  used  to  study  effective 
teaching,  problems  and  criticisms  abound.   First,  the 
effective  teaching  literature,  while  the  most  vigorous  and 
productive  of  research  programs,  relies  heavily  on 
correlational  findings  (see  Brophy  &  Good,  1986).   In  the 
effective  teaching  research,  the  absence  of  an  explanatory 
theory  of  the  relationships  between  teacher  behavior  and 
student  performance  has  been  criticized.   Critics  of  this 
research  typically  sought  to  develop  programs  of  research  in 
which  a  mediating  variable  (i.e.,  student  as  mediator  of 
instruction)  was  examined.   Further  limiting  the  effective 
teaching  research  is  the  lack  of  varied  settings.   Most  of 
the  studies  were  conducted  in  elementary  grades  with  the 
focus  on  reading  and  mathematics  achievement. 

A  second  limitation  is  research  on  teaching  has  largely 
been  conducted  by  researchers  interested  in  teaching. 
Omitted  from  this  literature  are  studies  by  teachers  and 
teachers'  perspectives  on  effective  teaching.   Teachers  often 
cite  affective  areas  such  as  enhancing  self-esteem  and 
meeting  emotional  needs  as  imperative  jobs  of  elementary 
teachers  (Reynolds,  1992)  .   Research  on  teaching,  however, 
tells  us  very  little  about  the  importance  of  these  tasks. 

Third,  assessment  developers  cannot  assume  that  the 
findings  of  correlational  and  descriptive  research  give  the 
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entire  view  of  teaching.   The  value  of  educational  research 
is  to  help  us  understand  and  learn  about  a  limited  range  of 
educational  phenomena,  particularly  when  research  is  done 
well.   Continued  research  on  effective  teaching  and  learning 
to  teach  will  only  improve  our  understanding  of  competent 
beginning  teaching. 
Assessment  of  Beginning  Teachers 

Few  would  argue  that  beginning  teachers  need  assessment 
to  a  greater  extent  than  experienced  teachers.   Fortunately, 
beginning  teachers  are  more  likely  to  support  teacher 
assessments  because  of  their  initial  positive  attitudes 
(Peterson,  1990).   Peterson  (1990)  described  four  problems  of 
evaluation  faced  by  beginning  teachers.   First,  many 
assessments  are  inaccurate  and  provide  limited  feedback  to 
the  teachers.   Second,  principals  have  been  given  the 
contradictory  roles  of  judge  and  supporter.   Third,  formative 
and  summative  evaluations  are  generally  administered  at  the 
same  time  and  often  by  the  same  assessor.   Fourth,  the 
feedback  given  to  beginning  teachers  is  generally  not  used  to 
shape  their  professional  development  plans .   Recent 
innovations  of  assessment  systems  enhance  the  effectiveness 
of  teacher  assessment  for  beginning  teachers  (Peterson, 
1984).   One  of  these  innovations  is  the  increasing  popular 
use  of  multiple  data  sources.   No  single  line  of  evidence  can 
provide  a  comprehensive  picture  of  what  a  competent  beginning 
teacher  does  (Medley  et  al . ,  1984).   Current  data  sources  for 
assessment  may  include  systematic  observation,  documentation 
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of  professional  activities,  teacher  tests,  parent  surveys, 
pupil  achievement  data,  peer  review,  and  other  individualized 
data  (Peterson,  1990) . 

Researchers  have  offered  a  few  suggestions  for  beginning 
teacher  assessment.   First,  the  time  of  formal  evaluation  is 
important.   Reynolds  (1992)  stated  that  beginning  teachers 
need  time  at  the  beginning  of  the  school  year  to  develop  an 
understanding  of  their  students  and  the  culture  of  their 
school .   Evaluation  of  competence  should  begin  after  a 
semester  of  full-time  teaching.   A  second  suggestion  is 
beginning  teacher  assessments  should  be  tailored  to  the 
specific  population  (i.e.,  beginning  teachers)  under 
consideration  (Berliner,  1989).   Those  assessing  beginning 
teachers  need  an  instrument  that  is  capable  of  capturing  the 
best  teaching  as  well  as  allowing  for  the  struggles  that 
beginning  teachers  are  inevitably  going  to  face.   The  current 
pass/no  pass  systems  are  not  flexible  enough  to  distinguish 
among  different  levels  of  teaching.   A  system  is  needed  that 
is  flexible  enough  to  weigh  different  competencies,  depending 
upon  whether  the  competencies  would  be  apt  to  develop  or 
should  have  been  attained  through  preservice  training. 
Conclusions 

After  her  review  of  the  research  on  effective  teaching 
and  studies  of  learning  to  teach,  Reynolds  (1992)  concluded 
"beginning  teachers  often  lack  an  adequate  knowledge  base  of 
understandings  to  perform  teaching  tasks  in  an  effective 
manner"  (p. 5).   Beginning  teachers  differ  from  experienced 
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teachers  not  only  in  a  knowledge  base  but  on  the  needs  of 
assessment.   Some  considerations  for  assessment  of  beginning 
teachers  include  (a)  the  use  of  multiple  data  sources,  (b) 
judgments  of  teacher  performance,  (c)  teacher  involvement, 
and  (d)  feedback  tied  to  professional  development  (Berliner, 
1990)  . 

Teacher  Development  Theory 

Knowledge  of  the  developmental  characteristics  that 
teachers  exhibit  during  their  careers  can  provide  educators 
with  an  understanding  of  the  abilities  and  inadequacies  of 
teachers  during  different  stages.   Information  about  these 
stages  can  serve  as  a  foundation  for  (a)  improving  preservice 
teacher  education  programs,  (b)  improving  staff -development 
programs,  and  (c)  improving  the  assessment  of  teacher 
performance . 
Teachers '  Developmental  Stages 

Several  research  studies  have  provided  detail 
descriptions  of  the  various  stages  of  teacher  development. 
The  most  prominent  of  these  studies  was  conducted  by  Frances 
Fuller  and  her  colleagues  (Fuller,  1969;  Fuller  &  Bown, 
1975).   Through  her  own  research  and  reviews  of  similar 
studies,  Fuller  concluded  that  teachers  progress  through  four 
stages  in  the  process  of  becoming  a  teacher.   The  first  stage 
is  the  preteaching  phase  in  which  preservice  teachers  cannot 
identify  with  teachers  but  rather  more  closely  identify  with 
the  pupils.   In  the  second  stage,  or  the  early  teaching 
phase,  teachers  are  primarily  concerned  with  survival  as 
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teacher  along  with  some  concern  for  the  content  of  lessons 
and  class  control .   The  third  stage  is  characterized  by  the 
teachers'  concerns  about  their  teaching  performance  and 
situational  demands  that  may  be  limiting  or  frustrating.   In 
the  fourth  stage  teachers  begin  to  show  more  concern  for 
their  pupils.   More  emphasis  can  be  seen  on  the  social  and 
emotional  needs  of  the  pupils.   Fuller  and  her  colleagues 
never  established  whether  the  proposed  stages  overlapped  or 
were  clearly  defined. 

Similarly,  Unruh  and  Turner  (1970)  proposed  four  stages 
of  teacher  growth  based  on  their  experiences  with  teachers . 
The  preservice   period  was  the  initial  stage  that  included 
preparation  at  the  high  school  and  college  level.  Initial 
teaching,    the  second  stage,  was  proposed  as  the  trial  phase 
that  could  last  for  1  to  6  years .   Although  Unruh  and  Turner 
do  not  explain  why  some  teachers  remain  in  this  stage  longer 
than  others,  they  noted  that  these  teachers  often  have 
difficulty  with  classroom  management,  organization, 
evaluation,  and  curriculum  development.   In  the  third  stage, 
the  teacher  embarks  on  the  security  period   which  ranges 
approximately  from  6  to  15  years.   During  this  phase, 
teachers  become  secure  in  their  commitment  to  teaching  and 
therefore  often  pursue  ways  to  improve  their  knowledge.   In 
the  final  stage,  maturity  period,    teachers  continue  to  refine 
their  competence  and  effectiveness.   These  teachers  have 
reached  a  level  at  which  they  are  confident  of  performing 
their  teaching  duties. 
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Another  4-stage  developmental  process  for  teachers  was 
proposed  by  Katz  (1972) .   Based  on  her  studies  with  preschool 
teachers,  Katz  described  the  characteristics  of  each  phase 
and  offered  suggestions  of  assistance  that  would  be  relevant 
to  each  stage  of  growth.   In  stage  one,  the  survival  stage, 
teachers  are  focused  primarily  on  survival  as  they  experience 
the  differences  between  their  expectations  and  the  realities 
of  a  classroom.   Because  teachers  may  feel  insecure  and 
inadequately  prepared,  Katz  suggested  on-site  support  for 
these  teachers.   Teachers  in  the  second  stage,  consolidation 
stage,    now  begin  to  remove  the  focus  from  themselves  and 
refocus  on  the  students.   This  stage  may  continue  from  a 
teacher's  second  year  into  the  third  year.   Again  Katz 
recommends  on-site  support  with  additional  assistance  from 
other  professionals  such  as  consultants  and  specialists.   In 
the  third  stage,  renewal,    teachers  begin  to  seek  out  new  ways 
of  teaching.   These  innovations  may  be  found  through 
conferences,  journals,  and  critiques  of  their  own  teaching. 
Maturity,    the  fourth  stage,  is  distinguished  by  the  ability 
of  teachers  to  ask  deeper  and  more  abstract  questions.   Katz 
suggests  that  assistance  at  this  stage  may  consist  of 
attending  seminars,  reading  books  and  journals,  and 
furthering  education  through  a  degree  program. 

After  studying  the  behavior  of  teachers,  Gregorc  (1973) 
and  his  colleagues  described  four  stages  of  development: 
becoming,  growing,  maturing,  and  fully  functioning 
professional.   In  the  becoming  stage,    teachers  demonstrate  a 
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limited  notion  of  their  teaching  duties.   Teachers  often  feel 
that  their  job  is  to  share  information  with  students  and 
complete  the  assigned  book  for  a  subject  area.   Initial 
concepts  of  teaching,  the  educational  process,  and  the  role 
of  a  school  are  just  beginning  to  develop  during  this  phase. 
In  the  growing  stage,    these  initial  concepts  become  more 
refined  as  teachers  increase  their  knowledge  about  students, 
materials,  curricula,  and  their  own  teaching.   Teachers 
moving  into  the  maturing  stage   have  made  a  commitment  to 
teaching.   They  have  reexamined  their  original  concepts  and 
gained  new  insights  to  education,  subject  matter,  and 
themselves .   Gregorc  found  that  those  teachers  who  reach  the 
fully  functioning  professional   stage   had  made  a  definite 
commitment  to  their  profession.   These  teachers  were  able  to 
see  their  full  potential  as  teachers  as  they  consistently 
tested  and  altered  their  concepts  and  beliefs. 

In  1980,  Yarger  and  Mertens  posited  a  continuum  of 
career  stages  that  teachers  experience,  based  on  their  work 
with  teachers  and  teacher  education.   Similar  to  the  work  by 
Katz,  Yarger  and  Mertens  also  described  types  of  programming 
assistance  that  would  be  appropriate  to  each  stage  of 
development.   At  Stages  1  and  2,  the  preeducation  and 
education  student  advances  to  a  point  of  making  a  conscious 
decision  and  commitment  to  becoming  a  teacher  and  develops 
the  basic  skills  necessary  for  this  decision.   In  stage  3, 
the  teacher  enters  the  first  year  of  teaching  and  encounters 
the  demands  of  the  teaching  profession.   Concerns  at  this 
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stage  include  classroom  discipline,  continuing  development  of 
pedagogical  skills,  and  receiving  constructive  feedback  from 
supervisors.   During  the  second  and  third  year  of  teaching, 
stage  4,  the  teacher  may  still  retain  some  of  the  initial 
concerns,  but  new  concerns  emanate  about  content  and  gaps  in 
previous  training.   At  stage  5,  the  teacher  may  have  from  3 
to  8  years  of  experience  and  thus  becomes  more  stable. 
Teachers  at  this  point  are  more  likely  to  have  completed 
advanced  degrees  and  additional  coursework.   Teachers  shift 
their  focus  to  content  expertise  and  new  professional  roles. 
Teachers  with  at  least  eight  years  of  experience  are  seen  in 
stage  6 .   Yarger  and  Mertens  described  these  teachers  as 
aware  of  their  particular  strengths  and  areas  of  expertise 
and  thereby  having  different  professional  needs. 

Another  theory  of  teachers '  developmental  stages  was 
suggested  by  McDonald  (1982).   This  model  consisted  of  four 
stages  including  (a)  the  transition  stage,  (b)  the  exploring 
stage,  (c)  the  invention  and  experimenting  stage,  and  (d)  the 
professional  teaching  stage.   The  transition  stage   was 
characterized  by  a  teacher's  low  sense  of  efficacy.   This  is 
compounded  with  fundamental  tasks  of  learning  about  students, 
and  learning  how  to  manage  and  organize.   In  the  invention 
and  experimenting  stage,    a  teacher  effectively  manages 
instruction  and  develops  a  sense  of  efficacy  in  using  the 
basic  skills  of  teaching.   This  second  stage  involves  the 
teacher  attempting  new  strategies,  developing  techniques,  and 
seeking  professional  growth.   In  the  final  stage, 
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professional    teaching,    the  teacher  has  problem-solving  skills 
and  often  will  assist  other  teachers  in  their  professional 
growth . 
Summary  of  Developmental  Stages 

Examination  of  these  theories  concerning  the  stages  of 
teachers '  development  suggests  three  predominant  stages  for 
inservice  teachers.   The  first  stage  is  distinguished  by  a 
teacher's  focus  on  self.   Difficulty  with  students, 
curricula,  discipline,  and  organization  seem  to  be  common 
issues  of  teachers  in  this  initial  phase  of  professional 
growth.   In  the  second  stage,  teachers  begin  to  refocus  their 
attention  on  students  and  mastery  of  content.   They  become 
more  knowledgeable  about  their  own  teaching  and  its  effects 
on  the  students.   The  third  or  final  stage  represents  a  time 
when  teachers  begin  to  feel  secure  about  their  teaching  and 
therefore  attempt  innovative  ways  to  expand  and  enhance  their 
teaching  skills. 

A  restriction  of  teacher  development  theory  is  the  lack 
of  clarity  in  the  range  of  competencies  exhibited  within  each 
stage.   Although  some  teacher  development  theorists  have 
suggested  characteristics  of  teacher  performance  for  each 
stage,  it  is  not  apparent  how  a  range  of  competency  may  be 
accounted  for.   Teachers  do  not  fit  neatly  into  one  stage  of 
development;  they  may  exhibit  behaviors  and  skills 
characteristic  of  other  stages.   For  example,  a  teacher  may 
be  highly  skilled  in  one  aspect  of  teaching  (e.g.,  lesson 
planning),  yet  the  teacher's  overall  classroom  performance 
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may  indicate  that  she  is  functioning  at  the  survival  stage. 
Theorists  offer  no  explanation  about  the  range  of 
competencies  that  may  be  exhibited  within  a  single  stage. 

Research  emerging  from  teacher  development  theory  has 
provided  a  foundation  for  understanding  teacher  concerns  at 
the  initial  stages  of  development.   However,  the  effects  of 
teacher  preparation  on  beginning  teacher  performance  have 
received  little  attention  in  teacher  development  research. 
Because  teacher  preparation  may  have  its  greatest  influence 
on  the  initial  stage  of  teacher  development,  teacher 
educators  should  have  more  information  on  this  particular 
stage  of  development  theory. 

Teacher  Evaluation 

The  much  publicized  decline  in  student  performance  has 
called  into  question  the  competency  of  teachers.   In  response 
to  public  demands  of  accountability,  the  educational 
establishment  has  taken  steps  to  improve  teachers. 
Evaluation  processes  have  become  a  widespread  solution  for 
ensuring  teacher  competency.   The  quality  of  evaluation 
depends  on  the  degree  to  which  selected  methods  will  provide 
reliable  and  valid  data  for  the  primary  purpose (s) . 
Purposes  of  Teacher  Evaluation 

The  two  major  functions  of  evaluation  are  formative  and 
summative.   Formative  evaluation  represents  a  process  or 
professional  development.   Formative  evaluation  provides 
data,  judgment,  and  suggestions  to  teachers  to  help  in  making 
appropriate  adjustments  on  their  teaching  performance. 
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Summative  evaluation  represents  a  product  or  accountability. 
This  type  of  evaluation  serve  administrative  decisions  such 
as  hiring,  firing,  promotion,  certification,  and  salary. 
Striking  a  balance  between  the  two  types  of  evaluation  could 
have  profound  implications  for  teacher  professionalism  and 
education  (Andrews  &  Barnes,  1990)  . 

The  first  step  in  the  process  of  evaluation,  whether 
formative  or  summative,  is  defining  the  purpose  or  multiple 
purposes  of  the  inquiry.   Although  teacher  evaluation  may 
have  explicit  and  specific  purposes,  the  effects  of  the 
evaluation  may  extend  into  unintended  areas.   For  instance, 
the  dismissal  of  a  teacher  for  incompetent  performance  has  an 
effect  not  only  on  that  teacher  but  on  other  teachers  in  the 
school  as  well.   Natriello  (1990)  proposed  three  purposes  for 
teacher  evaluation.   The  first  purpose,  to  control  or 
influence  the  performance  of  a  teacher,  is  to  improve 
performance  that  is  already  within  an  acceptable  range  for 
that  current  teaching  assignment.   Many  of  these  evaluation 
systems  use  criteria  that  are  based  on  effective  teaching 
research  (Medley,  Coker,  &  Soar,  1984)  or  on  models  of 
clinical  supervision  (Goldsberry,  1984)  .   The  second  purpose 
is  to  control  movement  in  and  out  of  positions  (i.e.,  hiring, 
firing,  certification) .   Some  examples  of  assessments  are 
pencil-and-paper  examinations  used  by  states  (districts)  to 
screen  applicants.   The  third  purpose  is  to  justify  the 
organizational  control  system.   The  emphasis  is  to  convince 
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employees  that  the  system  is  fair  and  equal,  valid  for 
decision-making  processes. 
Methods  of  Teacher  Assessment 

The  assessor  may  choose  various  methods  to  evaluate 
teachers.   The  type  of  method  chosen  should  be  fair, 
efficient,  credible,  and  accurate  (Millman,  1981)  .   Yet  the 
quality  of  the  method  depends  heavily  on  the  context  and 
manner  in  which  the  method  is  implemented.   Evaluation  of 
teachers  must  identify  and  define  possible  contexts  and  take 
into  account  their  influences.   Our  selection  of  assessment 
methods  have  grown  significantly  over  the  past  20  years.   In 
the  following  section,  various  sources  of  teaching  evidence 
are  presented. 

Teacher  ratings .   Teacher  rating  scales  were  first  used 
in  late  19th  century.   As  interest  in  teacher  effectiveness 
increased  in  the  early  20th  century,  thousands  of  studies 
were  conducted  using  rating  scales  (Good  &  Mulryan,  1990)  . 
Teacher  ratings  quickly  gained  popularity  among 
administrators  for  summative  evaluation  purposes  (i.e., 
promotion,  transfer,  dismissal,  and  merit).   The  increased 
use  of  teacher  rating  scales  was  accompanied  by  a  multitude 
of  problems  (Medley  &  Mitzel,  1963),  such  as  a  lack  of 
criteria  and  objective  measures  for  the  ratings.   Moreover, 
the  information  obtained  from  teacher  ratings  has  never 
informed  us  of  what  should  be  rated  and  how  rating  is  best 
accomplished.   Medley  et  al .  (1984)  acknowledged  the  strength 
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of  rating  instruments  is  in  helping  teachers  to  analyze  and 
improve  their  instruction. 

Self-assessments .   Self-assessments  of  teacher 
performance  are  formative  in  nature  with  personal  development 
as  their  primary  purpose.   Self -assessments,  including  audio- 
and  videotapes,  self-reports,  questionnaires,  and  self-rating 
forms,  allow  insight  into  a  teacher's  own  strengths  and 
weaknesses.   However,  self-assessments  have  several 
limitations,  such  as  lack  of  objectivity,  accuracy,  and 
reliability  (Barber,  1990) .   Assessment  may  become  a  form  of 
justification,  in  which  ineffective  teachers  may  not  realize 
the  true  level  at  which  they  are  performing.   For  example, 
when  novice  teachers  view  videotapes  of  their  own  teaching, 
they  tend  to  have  difficulty  focusing  on  matters  of 
significance. 

Student  achievement .   If  the  function  of  teaching  is  to 
enhance  student  learning,  then  using  student  achievement  as  a 
measure  of  teacher  performance  seems  reasonable.   Although 
student  achievement  measures  are  used  for  both  formative  and 
summative  evaluations,  using  these  measures  for  summative 
evaluations  results  in  more  controversy  simply  because  more 
is  at  stake.   Millman  (1981)  described  three  limitations  of 
using  student  achievement  as  a  method  of  teacher  assessment . 
One  limitation  is  that  students  differ  in  their  levels  of 
academic  aptitude  and  willingness  to  learn.   Individual 
differences  among  students  are  rarely  taken  into  account  with 
student  achievement  measures.   Another  limitation  is  that 
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student  achievement  measures  cannot  tell  how  the  teacher 
planned  and  implemented  the  lesson  and  therefore  are  limited 
in  their  usefulness  for  improving  instruction.   Finally,  the 
achievement  tests  may  not  be  representative  of  what  is  being 
taught  or  may  only  sample  a  set  of  the  instruction  goals. 
This  is  particularly  evident  in  secondary  schools  where  the 
measures  of  student  achievement  are  not  aligned  with  the 
curriculum  (Glass,  1990). 

Portfolio  assessment.   The  portfolio  as  an  evaluation 
instrument  is  an  idea  borrowed  from  other  professions,  such 
as  architecture,  writing,  and  photography.   Bird  (1990) 
discussed  the  potential  of  portfolio  assessment  for  teacher 
evaluation.   He  identified  two  purposes  of  portfolios: 
contributing  to  personnel  decisions  and  improving  teacher 
performance.   A  wide  array  of  documents  (e.g.,  photographs, 
videotapes,  written  products,  and  lesson  plans)  could  be 
included  in  a  teacher's  portfolio.   Portfolios  are  gaining 
popularity  because  they  provide  opportunities  to  see  a 
teacher's  work  holistically  and  in  context  (Shulman,  1989). 
Yet  a  different  set  of  problems  is  inherent  in  portfolio 
assessment.   Shulman  (1988)  claimed  that  portfolios  are  often 
too  large  and  become  a  waste  of  time  if  contents  do  not 
reveal  how  teachers  actually  teach  in  their  classrooms. 
Another  problem  is  the  lack  of  standard  documentation 
procedures . 

Simulations/performance  exercises.   Simulations  or 
performance  exercises  are  assessments  that  are  conducted 
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outside  of  the  classroom  but  are  designed  to  simulate  actual 
practice.   Stanford's  Teacher  Assessment  Project,  under  the 
direction  of  Lee  Shulman,  led  the  research  and  development  of 
performance  exercises.   These  exercises  included  planning 
lessons,  commenting  on  videotapes  of  other  teachers' 
performances,  critiquing  textbooks,  and  correcting  homework 
papers  (Shulman,  Haertel,  &  Bird,  1988).   Performance 
exercises  can  simulate  the  complexities  of  teaching  and  allow 
for  inferences  about  decision-making  capabilities  (Dwyer, 
1993).   The  major  limitation  of  these  methods  is  that  the 
teacher  is  still  removed  from  the  actual  contexts  and  thus 
the  direct  relationship  of  teaching  to  learning  is  lost 
(Dwyer,  1993;  Haertel,  1990)  .   Other  limitations  of  this 
method  are  that  it  is  expensive  to  administer,  create,  and 
evaluate  and  that  it  samples  the  depth  of  a  teacher's 
knowledge  rather  than  the  breadth.   In  addition,  performance 
exercises  are  task  specific  so  the  validity  and  reliability 
of  these  instruments  are  dependent  on  the  type  of  task 
demands  (Shulman,  1988)  .   There  is  growing  interest  in 
performance  exercises,  but  they  are  not  yet  widely  accepted 
due  to  the  problems  with  this  technique.   Many  efforts  to  use 
simulation  and  performance  exercises  are  addressing  these 
problems  and  are  still  in  the  development  stages. 

Paper-and-pencil  tests.   At  least  46  states  have  adopted 
teacher-competency  tests  as  a  prerequisite  for  teacher 
certification  (Darling-Hammond,  1990) .   The  main  advantage  of 
these  conventional  tests  is  that  they  can  adequately  sample 
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the  breadth  of  teacher  knowledge.   Conventional  tests  are  (a) 
efficient,  (b)  easy  to  score,  (c)  highly  reliable,  and  (d) 
objective.   They  are  incomplete,  however,  because  they 
measure  isolated  pieces  of  knowledge,  omitting  processes  such 
as  judgment,  problem  solving,  and  decision  making  (Madaus  & 
Mehrens,  1990;  Shulman,  1988).   In  summary,  paper-and-pencil 
tests  play  an  important  role  in  teacher  evaluation  but  fall 
short  of  providing  information  to  improve  teacher 
performance. 

Classroom  observation.   Classroom  observations  are  the 
dominant  method  of  teacher  evaluation  in  elementary  and 
secondary  schools  today.   To  assess  teacher  behavior 
(action) ,  classroom  observation  seems  to  be  the  leading 
method;  however,  observations  are  not  without  their 
limitations.   Most  notably,  researchers  regard  observations 
as  a  limited  tool  in  evaluating  teacher's  thinking  (thought) 
(Darling-Hammond,  1990;  Medley  et  al . ,  1984;  Shulman,  1988; 
Stodolsky,  1990)  . 

Classroom  observation  as  a  method  of  teacher  assessment 
can  assume  different  forms,  including  behavior  checklists, 
category  systems,  summaries,  and  narrative  records  (See 
Evertson  &  Green,  1986)  .   Observation  systems  may  be  open  or 
closed,  each  with  unique  characteristics.   In  open  systems, 
the  assessor  makes  a  full  description  of  all  behavior  as  it 
occurs  without  any  reference  to  interpretation.   Examples  of 
open  systems  are  narrative  records  and  summaries.   These 
systems  produce  a  rich  description  of  classroom  events  and 
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provide  specific  examples  for  discussion  or  analysis.   In 
particular,  narrative  records  have  several  advantages. 
First,  narrative  records  allow  for  a  natural  approach  to 
understanding  the  classroom.   Second,  narrative  records  can 
preserve  the  original  sequencing  of  behavior  and  the  context 
in  which  it  occurs.   This  holistic  approach  is  more 
comprehensive  than  selective  approaches  such  as  category 
systems  which  are  discussed  next  (Evertson  &  Holley,  1981)  . 

In  contrast,  closed  systems  center  on  specific  types  or 
patterns  of  behavior,  as  exemplified  by  behavior  checklists 
and  category  systems.   Within  a  closed  system,  the  assessor 
records  a  behavior  (or  lack  of  behavior) ,  event,  or 
interaction  sequence  (Stodolsky,  1990). 

Another  dimension  of  observation  systems  is  whether  they 
are  high  inference  or  low  inference.   Low  inference  systems 
require  the  assessor  to  identify  behaviors  that  are  codified. 
The  Florida  Performance  Measurement  System  (FPMS)  and  the 
Classroom  Observations  Keyed  for  Effectiveness  Research 
(COKER)  are  two  examples  of  low  inference  systems.   Although 
these  systems  have  strong  reliability  and  require  less 
assessor  training,  the  disadvantage  is  that  teaching  is 
viewed  as  a  sum  of  discrete  behaviors.   Conversely,  high 
inference  systems  emphasize  teaching  as  a  holistic  activity 
within  the  context  of  a  particular  classroom.   High  inference 
systems  demand  more  assessor  training  and  suffer  from  lower 
reliability.   An  example  of  a  high  inference  system  is  the 
Salt  Lake  City  procedure  (See  Wise,  Darling-Hammond, 
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McLaughlin,  &  Bernstein,  1984),  in  which  each  classroom  is 
considered  a  contextual  unit.   Instead  of  focusing  on  generic 
competencies,  the  district's  conception  of  teaching  is  that  a 
variety  of  instruction  approaches  are  compatible  with 
effective  teaching. 

Although  observation  systems  may  potentially  help 
teachers  conceptualize  their  teaching  behaviors,  they  are 
riddled  with  problems  (Good,  1980) .   One  problem  is  that 
observation  systems  are  adopted  too  casually  by  state 
education  agencies.   Typically,  one  state  develops  a  system 
and  other  states  become  interested.   Seldom  are  the  purposes 
and  limitations  of  new  systems  explored  prior  to  adoption.   A 
second  problem  is  the  simplicity  of  observation  systems: 
Only  a  few  behaviors  are  measured.   Most  observation  systems 
assume  that  certain  patterns  of  behavior  are  effective, 
resulting  in  an  overinterpretation  of  particular  behaviors. 
Another  weakness  of  observation  systems  is  their  inability  to 
assess  preactive  teaching  behaviors  such  as  teacher  thinking. 
Most  classroom  observations  use  nominal  systems  of  two 
categories:   satisfactory  and  unsatisfactory.   Although  these 
categories  may  be  useful  for  employment  retention  or 
dismissal,  they  are  glaringly  inadequate  at  contributing 
substantively  to  teachers'  professional  development,  another 
purpose  of  assessment. 

Despite  criticisms,  classroom  observations  are  likely  to 
be  the  centerpiece  of  systematic  assessment  processes. 
Improvements,  however,  are  still  needed.   First,  greater 
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clarity  about  the  place  of  effective  teaching  behavior  in 
quality  teaching  is  imperative  (Evertson  &  Holley,  1981). 
Second,  researchers  must  determine  optimum  times  in  a 
teacher's  career  for  observation.   Third,  procedures  for 
observations  need  further  refinement. 
Summary 

Peterson  (1984)  described  two  models  of  teacher 
evaluation:   discrepancy  and  emergent.   The  discrepancy  model 
defines  a  standard  of  good  teaching  and  then  compares 
teachers  to  this  standard.   Teacher  quality  is  judged  by  how 
close  teacher  behavior  matches  behavior  that  is  correlated 
with  high  student  outcomes.   A  problem  with  the  discrepancy 
model  is  that  there  is  no  universally  agreed-upon  description 
of  quality  teaching.   Another  problem  involves  criteria  or 
methods  that  are  unfair  to  particular  individuals  (e.g., 
standardized  testing) .   Finally,  the  possession  of  minimum 
competencies  to  meet  a  standard  of  teaching  does  not 
guarantee  their  effective  use  in  practice. 

The  emergent  model  asserts  that  teaching  is  contextually 
and  situationally  dependent.   When  judging  teacher 
performance  and  effectiveness,  an  assessor  must  consider  (a) 
the  complexity  of  teaching,  (b)  the  value  of  teaching  related 
to  specific  students,  and  (c)  the  contextual  dependency  of 
teaching.   Emergent  evaluations  entail  value  judgments  in  the 
form  of  a  statement  with  supporting  lines  of  evidence. 

Methods  of  teacher  assessment  have  strengths  and 
limitations  based  on  the  purposes  of  evaluation.   Mehrens 


36 

(1990)  stressed  the  importance  of  combining  evaluation  data 
from  multiple  sources,  particularly  when  career  decisions  are 
made. 

Because  evaluations  of  teachers  can  lead  to  significant 
decisions,  assessment  systems  should  provide  the  best  data 
possible.   Conceivably,  an  ideal  teacher  assessment  would 
incorporate  multiple  sources  of  evidence  about  teachers  and 
their  effects  on  students  (Mehrens,  1990;  Shulman,  1988; 
Stodolsky,  1990)  .   High-stakes  decisions  about  teachers  put 
great  demands  on  teacher  assessment  methods.   Each  method  is 
a  lens  into  the  complexity  of  teaching.   In  general,  the  more 
lenses  that  are  looked  through,  the  better  the  decision  is 
likely  to  be  (Mehrens,  1990).   The  following  assessment 
methods  each  have  their  own  advantage.   Pre-  and  post- 
observation  interviews  can  provide  additional  information 
about  teacher  planning  and  thinking.   Paper-and-pencil  tests 
may  be  used  to  assess  subject-matter  knowledge  and 
pedagogical  content  knowledge.   Evidence  of  student  learning 
and  attitudes  may  also  be  helpful.   Finally,  classroom 
observations  give  us  a  view  of  the  interaction,  climate,  and 
rapport  of  the  classroom  that  is  available  from  no  other 
source. 

Praxis  III:   Classroom  Performance  Assessments 
Purpose 

In  1987,  the  Educational  Testing  Service  (ETS)  created 
and  funded  a  group  of  test  development  leaders  who  were 
instructed  to  turn  educational  and  measurement  goals  into 
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reality.   It  was  the  job  of  one  development  leader,  Carol 
Anne  Dwyer,  to  redesign  the  ETS  assessment  process  for 
licensing  beginning  teachers  and,  in  turn,  to  create  a  new 
generation  of  assessment  methods.   These  new  teacher 
assessments  were  to  benefit  the  individuals  being  assessed 
and  others  who  would  make  use  of  information  regarding 
beginning  teacher  performance.   ETS  expected  the  results  of 
this  effort  to  be  available  by  1992.   Several  requirements 
were  made  of  this  project.   First,  the  project  must  function 
from  a  solid  research  and  development  foundation  and  build  on 
technology  and  educational  reform.   Second,  the  project 
should  coalesce  with  other  research  and  development  efforts, 
such  as  Stanford's  Teacher  Assessment  Project,  the  Holmes 
Group,  the  Rand  Corporation,  research  at  Michigan  State 
University,  and  the  Board  for  Professional  Teaching 
Standards.   Third,  the  answers  to  questions  of  measurement, 
technology,  and  educational  policy  should  have 
generalizability  to  other  assessment  situations  (Dwyer, 
1989) . 

The  initial  goal  was  to  identify  important  events  in  the 
process  of  becoming  a  teacher  and  develop  multiple  assessment 
methods.   At  these  times  and  with  the  appropriate  methods, 
individuals  would  be  assessed  on  enabling  skills,  subject- 
matter  knowledge,  pedagogical  knowledge,  and  pedagogical - 
content  skills. 

The  Praxis  Series:      Professional  Assessments   for 
Beginning  Teachers™   is  a  comprehensive  series  of  classroom 
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performance  assessments  for  beginning  teachers.   The 
assessment  consists  of  three  stages  that  are  part  of  the 
licensing  process.   Each  stage  corresponds  to  events  in  a 
teacher's  career  and  in  licensing  decisions. 

Stage  1 .   Stage  1  assessments  are  designed  to  be  taken 
as  early  as  possible  in  a  student's  undergraduate  program  or 
soon  after  the  decision  to  become  a  teacher  is  made.   Using  a 
computer-based  approach,  prospective  teachers  are  evaluated 
on  enabling  skills  (i.e.,  reading,  writing,  and  mathematics). 
Practice  tests  are  a  special  feature  of  the  first  stage 
(Dwyer,  1991)  . 

Stage  2 .   In  the  second  stage,  the  Praxis  II:   Subject 
Assessments  assesses  subject-matter  knowledge  and  pedagogical 
principles.   These  assessments  utilize  the  more  traditional 
assessment  methods  of  paper-and-pencil  measures.   Completion 
of  these  assessments  should  take  place  at  the  end  of  teacher 
preparation  or  formal  coursework.   Although  Praxis  II  is 
nationally  developed  and  administered,  individual  states  may 
tailor  some  of  the  modules  (Dwyer,  1991) . 

Stage  3 .   The  third  stage  of  the  Praxis  Series,  Praxis 
III:      Classroom  Performance  Assessments,    emphasizes 
understanding  and  making  judgments  about  the  act  of  teaching. 
Praxis  III  does  not  duplicate  the  assessment  of  subject- 
matter  knowledge  (Praxis  II)  but  assesses  the  application  of 
this  knowledge  in  specific  classroom  settings.   This  final 
assessment  is  designed  to  be  administered  toward  the  end  of 
an  internship  or  during  the  first  year  of  teaching  for  those 
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states  requiring  a  performance-based  assessment  as  a  part  of 
licensing.   Although  Praxis  III  is  predominantly  a 
performance-based  assessment,  a  paper-and-pencil  task  is 
required  to  provide  classroom  and  instructional  information. 
The  entire  Praxis  Series:      Professional  Assessments   for 
Beginning  Teachers™   was  developed  for  licensing  decisions  of 
beginning  teachers  typically  made  by  states  or  local 
education  agencies.   Praxis  III,  however,  was  not  intended 
for  use  in  making  decisions  about  teachers  who  are  already 
licensed  (Dwyer,  1994) .   Praxis  III  is  the  subject  of  the 
remainder  of  this  section,  which  includes  a  description  of 
the  development  of  the  knowledge  base,  the  relationship 
between  assessment  and  professional  development,  the 
instrument  development ,  and  the  emerging  uses . 
Guiding  Conceptions  and  Assessment  Principles 

A  conception  of  teaching  and,  specifically,  a  conception 
of  effective  teaching  are  fundamental  to  teacher  assessment, 
yet  the  conception  is  often  not  stated  clearly  by  developers 
because  of  empirical,  theoretical,  and  value  differences 
about  the  characteristics  of  good  teaching  (Stodolsky,  1990) . 
During  the  initial  stages  of  the  development  of  Praxis  III, 
the  researchers  found  it  necessary  to  state  explicitly  a 
guiding  conception  of  teaching  and  learning  and  a  set  of 
criteria  for  assessment  of  beginning  teaching.   The  guiding 
conceptions  are  founded  in  Dwyer  and  Villegas's  (1993) 
multicultural  view  of  teaching.   They  maintain  that  teaching 
requires  engaging  students  as  active  learners  to  promote 
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changes  in  their  pre-existing  knowledge.   Additionally, 
teachers  must  consider  students'  background,  experiences, 
interests,  and  abilities  and  must  continually  accommodate  the 
diverse  needs  of  their  students  by  modifying  their  teaching. 
In  operationalizing  this  conception,  the  developers  of  Praxis 
III  used  three  assessment  principles  (Dwyer,  1993).   First, 
teacher  assessment  should  contribute  to  the  understanding  of 
teaching.   Teacher  assessments  should  not  only  reflect  the 
view  of  teachers  as  professionals  but  should  also  reveal  the 
future  direction  of  the  profession.   Second,  teacher 
assessment  should  represent  the  complexity  of  teaching  and 
learning,  avoiding  the  prescription  of  a  right  way  to  teach. . 
Multiple  assessment  methods  grounded  in  theory  and  practice 
are  necessary  because  teaching  is  complex  and  highly 
interactive.   Further,  teacher  assessment  is  a  process  that 
entails  a  high  degree  of  professional  judgment.   Third, 
teacher  assessment  should  promote  equity  among  all  teachers 
and  students. 
Instrument  Development 

What  aspects  of  teaching  should  be  assessed?   The 
process  of  developing  a  knowledge  base  for  Praxis  III  took 
approximately  6  years .   The  goal  of  the  developers  was  to 
identify  the  knowledge  base  in  research  and  practice  and  to 
translate  this  knowledge  base  into  criteria  that  illustrate 
teaching  and  can  be  fairly  and  validly  assessed.   During  this 
process,  three  main  sources  were  used:   practitioners,  the 
research  community,  and  state  teacher  licensing  authorities 
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(Dwyer,  1993,  1994).   These  sources  represent  three 
fundamentally  different  paradigms,  because  their  basic 
assumptions,  methodologies,  and  values  differ.   With  the 
practicing  teachers,  three  formal  job  analyses  were  conducted 
on  the  requirements  of  elementary,  middle,  and  high  school 
teaching.   Practicing  teachers  were  asked  about  the 
importance  of  specific  aspects  of  the  work  of  beginning 
teachers.   Teachers  were  encouraged  to  make  suggestions  about 
other  aspects  of  teaching  that  they  deemed  significant.   For 
the  research/theoretical  perspective,  a  series  of  research 
reviews  about  important  knowledge  and  skills  for  beginning 
and  experienced  teachers  were  conducted,  with  particular 
emphasis  on  multicultural  educational  practices.   For  the 
state  perspective,  a  nationwide  content  analysis  of  state 
performance  assessment  requirements  was  conducted. 

From  these  main  sources  came  the  knowledge  base  that 
Praxis  developers  drafted  into  an  initial  set  of  assessment 
criteria.   After  several  iterations  of  the  criteria  by  a 
national  advisory  panel  including  experienced  teachers, 
prominent  teacher  educators,  and  ETS  staff,  cycles  of 
fieldwork  began.   Most  of  the  fieldwork  was  conducted  in 
Delaware  and  Minnesota  with  the  help  of  teachers .   These 
teachers  became  involved  in  refining  the  assessment  criteria 
and  scoring  rules,  developing  the  assessor  training  process, 
and  piloting  the  system. 

Two  important  tests  of  quality  were  necessary  before  the 
criteria  were  accepted.   First,  the  criteria  had  to  exemplify 
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the  essentials  of  good  professional  practice  that  teachers 
acknowledge.   Several  revisions  resulted  from  a  better 
understanding  of  teachers'  perception  of  their  work  (Powers, 
1992;  Rosenfeld,  Freeberg,  &  Bukatko,  1992;  Rosenfeld, 
Reynolds,  &  Bukatko,  1992;  Rosenfeld,  Wilder,  &  Bukatko, 
1992;  Wesley,  Rosenfeld,  &  Sims-Gunzenhauser,  1993).   The 
second  test  of  quality  was  determining  whether  the  criteria 
reflected  the  relationship  between  teacher  education  and  the 
indicators  of  the  requirements  of  teaching  competency.   To 
some  extent,  the  relationship  is  important  for  aligning 
teachers'  perceptions  of  their  preparation  with  the  realities 
of  their  work. 
Praxis  III  Framework 

The  results  of  intensive  research  and  fieldwork  were  19 
specific  assessment  criteria  grouped  into  four  domains: 
organizing  content  for  student  learning,  creating  an 
environment  for  student  learning,  teaching  for  student 
learning,  and  advancing  teacher  professionalism.   Because  the 
underlying  conception  states  that  teaching  is  complex  and 
interactive,  these  domains  should  be  thought  of  as 
interrelated,  not  independent  components  (Dwyer,  1993).   The 
four  domains  are  described  briefly  along  with  the  specific 
criteria  composing  each  domain  (See  Appendix  A) .   For  further 
description  of  each  criterion,  the  reader  is  referred  to 
Dwyer  (1994)  or  the  Praxis  III  materials. 

Domain  A:   Organizing  content  knowledge  for  student 
learning.   Application  of  content  knowledge  is  the  focus  of 
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assessment  in  Domain  A.   With  their  students'  background 
knowledge  and  experience  in  mind,  teachers  must  (a)  decide  on 
learning  goals,  (b)  sequence  instruction  for  curricular 
goals,  (c)  select  appropriate  methods,  activities,  and 
materials,  and  (d)  select  evaluation  strategies  to  reflect 
learned  goals.   These  criteria  are  assessed  primarily  through 
teacher-prepared  written  documentation  and  semi-structured 
interviews.   Classroom  observation  may  also  contribute  to  the 
assessment  evidence. 

Domain  B:   Creating  an  environment  for  student  learning. 
The  focus  of  Domain  B  is  on  the  personal  interactions  in  the 
classroom  between  teachers  and  students  and  among  students. 
Teachers  address  issues  of  (a)  fairness,  (b)  rapport,  (c) 
challenging  expectations,  (d)  standards  of  classroom 
behavior,  and  (e)  the  safety  of  the  physical  environment. 
Although  classroom  observations  will  provide  the  primary 
evidence  for  this  domain,  supporting  evidence  may  be  used 
from  the  semi -structured  interviews. 

Domain  C:   Teaching  for  student  learning.   Domain  C 
relates  to  the  act  of  teaching  in  which  the  purpose  is  to 
connect  the  students  with  the  content.   Content  refers  to  the 
knowledge,  skills,  perceptions,  and  values  of  subject  matter. 
Teachers  provide  evidence  of  (a)  clear  goals  and  procedures, 
(b)  comprehensible  content,  (c)  extended  student  thinking, 
(d)  monitoring  understanding,  and  (e)  effective  use  of 
instructional  time.   Most  of  the  evidence  for  these  criteria 
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will  be  drawn  from  classroom  observation.   Information  gained 
through  interviews  may  enhance  the  evidence. 

Domain  D:   Teacher  professionalism.   In  this  domain, 
teachers  evaluate  their  own  effectiveness  and  discuss  aspects 
of  the  lesson.   The  assessor  obtains  information  through  a 
postobservation  interview.   Questions  will  focus  on  (a) 
meeting  learning  goals,  (b)  attaining  a  sense  of  efficacy, 
(c)  building  professional  relationships,  and  (d) 
communicating  with  parents/guardians. 

There  are  three  main  steps  in  the  assessment  process  of 
Praxis  III.   The  first  step  involves  the  assessor  collecting 
data  in  a  variety  of  ways:   conferences,  interviews, 
observation,  and  documentation.   In  the  next  step,  the 
assessor  reflects  and  analyzes  the  data  collected.   For  the 
final  step,  the  assessor  reaches  a  judgment  about  the 
teacher's  performance.   To  provide  feedback  to  the  teacher, 
the  assessor  provides  explanations  and  summary  documentation. 
Each  criterion  has  a  rating  scale  that  includes  illustrations 
at  each  of  three  levels  of  performance.   These  are  used  as 
guides  by  the  assessor  when  interpreting  data.   Questions  are 
provided  for  assessor  reflection  (See  Appendix  B) . 
Reflection  and  Performance 

Praxis  III  was  designed  under  the  assumption  that 
effective  teaching  requires  both  thought  and  action  working 
simultaneously.   In  keeping  with  this  assumption,  each  domain 
is  examined  from  both  perspectives  (Dwyer,  1994)  .   Thus,  an 
examination  of  each  domain  requires  multiple  methods  of 
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assessment  (i.e.,  classroom  observation,  teacher -prepared 
written  documents,  and  semi-structured  interviews). 

Critical  to  a  teacher's  thought  and  action  is  the 
conception  that  each  perspective  must  be  adapted  to 
accommodate  the  specific  students  in  a  particular  teaching 
situation.   Effective  teaching  then  relies  on  knowledge  of 
subject  matter  and  students.   Teacher  assessment  should  focus 
on  how  a  teacher  adapts  instruction  to  four  classroom  context 
variables:   subject  matter,  students'  individual  differences, 
students'  developmental  levels,  and  students'  cultural 
backgrounds.   Consequently,  teacher  assessment  should  not 
impose  the  use  of  any  particular  method  of  teaching. 
Assessment  and  Professional  Development 

Praxis  III  has  the  primary  purpose  of  a  summative 
evaluation—licensing  beginning  teachers.   A  formative  role, 
however,  is  needed.   The  developers  of  Praxis  III  believe  the 
following  basic  principle:   assessment  must  be  targeted  on 
the  teacher's  level  of  professional  development.   It  is 
unlikely  that  beginning  teachers  possesses  all  the  knowledge 
and  skills  of  competent  teachers.   Teaching  effectiveness 
develops  slowly  and  gradually.   The  process  of  acquiring 
knowledge  and  skills  of  an  expert  teacher  takes  years. 
Therefore  assessments  of  beginning  teachers  should  provide 
sound  information  for  professional  development.   In  turn, 
these  assessments  should  be  aligned  with  later  assessments, 
such  as  those  by  the  National  Board  of  Professional  Teaching 
Standards  (NBPTS) .   The  Praxis  III  performance  assessment 
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criteria  has  been  compared  to  (a)  the  early 

adolescence/generalist  standards  of  the  NBPTS,  (b)  the  model 
standards  for  beginning  teachers  of  the  Interstate  New 
Teacher  Assessment  and  Support  Consortium,  and  (c)  the 
outcome-based  standards  of  the  National  Association  of  State 
Directors  of  Teacher  Education  and  Certification  (Ingwerson, 
1994)  . 

The  formative  information  gained  through  Praxis  III 
should  provide  a  learning  experience  for  the  beginning 
teacher.   If  the  ability  to  teach  can  be  acquired,  then 
beginning  teachers  should  be  given  the  opportunity  to 
improve.   Teacher  assessments  should  contribute  information 
about  the  knowledge  and  skills  that  are  being  evaluated. 
Implications  for  Research 

The  literature  reviewed  in  this  chapter  provides  a 
theoretical  and  empirical  basis  for  this  study.   Little  is 
known  about  the  effects  of  teacher  preparation  on  the 
classroom  performance  of  beginning  teachers.   Researchers 
have  confirmed  the  differences  between  programs  in  general 
and  special  education  in  terms  of  traditional  program 
characteristics.   Recent  studies  have  examined  the 
differences  in  how  experienced  general  and  special  education 
teachers  think  and  make  decisions. 

The  literature  on  effective  teaching  and  learning  to 
teach  has  presented  us  with  considerable  information  on  what 
beginning  teachers  know  and  do  and  what  effective  teachers 
know  and  do.   Reynolds  (1992)  stated  that  teacher  assessment 


47 

developers  are  left  with  the  task  of  deciding  what  competent 
beginning  teachers  should  know  and  do.   More  examination  is 
needed  into  how  competent  performance  may  differ  across 
teaching  philosophies  and  orientations. 

Teacher  development  theory  provides  a  basis  for 
examining  teachers  in  different  stages  of  their  development. 
By  starting  to  construct  profiles  of  first-year  teachers 
through  Praxis  III,  teacher  educators  could  use  this 
developmental  information  to  revise  instructional  content  and 
learning  experiences  to  meet  preservice  teachers ' 
developmental  needs  and  to  promote  further  growth.   In 
addition,  Praxis  III  may  be  used  to  delineate  and  solve  the 
problems  and  limitations  of  teacher  development  theory. 

The  current  trend  toward  sound  assessments  for  teacher 
licensure  has  produced  an  innovative  teacher  assessment 
system  in  The  Praxis  Series:      Professional  Assessments    for 
Beginning  Teachers™.      The  use  of  Praxis  III  for  licensure 
will  have  broad  effects  for  teacher  education. 

This  study  begins  to  establish  a  research  base  by 
examing  the  effects  of  teacher  preparation  on  the  classroom 
performance  of  beginning  teachers.   As  profiles  of  these 
teachers  begin  to  emerge,  the  role  of  teacher  development 
theory  in  teacher  preparation  may  become  more  clear  to 
teacher  educators . 


CHAPTER  III 
METHODS  AND  PROCEDURES 

Introduction 

The  purpose  of  this  study  was  to  compare  the  effects  of 
teacher  preparation  on  the  classroom  performance  of  beginning 
teachers  in  special  and  general  education.   Several  key 
aspects  of  classroom  performance  were  examined:   (a) 
organizing  content  knowledge  for  student  learning,  (b) 
creating  an  environment  for  student  learning,  (c)  teaching 
for  student  learning,  and  (d)  teacher  professionalism.   To 
determine  these  effects,  observations  using  Praxis  III: 
Classroom  Performance  Assessment  were  conducted.   In  this 
chapter,  the  methods  and  procedures  of  the  study  are 
presented.   The  chapter  begins  with  a  review  of  the 
hypothesis.   The  second  section  presents  the  methods  and 
includes  descriptions  of  the  subjects  and  sampling 
procedures.   The  subsequent  sections  include  descriptions  of 
the  research  procedures  and  the  treatment  of  data. 
Description  of  the  Null  Hypothesis 

The  following  null  hypothesis  was  tested  in  the  study: 
There  is  no  statistically  significant  difference  between 
beginning  special  education  and  beginning  general  education 
teachers  on  measures  of  classroom  performance. 
The  19  criteria  of  Praxis  III  were  used  to  test  this 
hypothesis . 
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Methods 
Description  of  the  Subjects 

The  sample  consisted  of  47  teachers  teaching  in  public 
elementary  schools  in  Florida.   Information  about  each 
teacher  was  obtained  through  the  completion  of  a  candidate 
profile  (see  Appendix  C) .   Each  teacher  in  the  sample  was  a 
graduate  from  a  teacher  preparation  program  at  one  of  four 
state  universities:   University  of  Florida  (UF)  ,  Florida 
State  University  (FSU) ,  University  of  Central  Florida  (UCF) , 
and  University  of  South  Florida  (USF) .   All  teachers  were 
employed  in  positions  for  which  they  were  certified  (e.g., 
special  education  teacher  with  special  education  degree) .   As 
first-year  teachers,  they  were  participants  in  the  Florida 
Professional  Orientation  Program  (POP) ,  a  state  required 
beginning  teacher  program.   All  observations  took  place  at 
comprehensive  elementary  schools  that  included  kindergarten 
through  fifth  grade.   Although  most  teachers  in  the  study 
taught  all  or  most  elementary  school  subjects,  some  special 
and  general  education  teachers  had  a  primary  teaching 
assignment  of  reading/language  arts  or  math/sciences. 
Sampling  Procedures 

To  identify  a  pool  of  beginning  teachers,  a  list  of 
graduates  and  the  districts  in  which  they  were  employed  was 
obtained  from  the  Florida  Department  of  Education.   The  total 
pool  of  qualified  beginning  teachers  (general  and  special 
education)  was  plotted  on  a  map  of  the  Florida  districts. 
Several  districts  were  eliminated  for  the  following  reasons: 
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(a)  unbalanced  numbers  of  available  general  and  special 
education  teachers,  (b)  unrepresentative  numbers  from  the 
four  state  universities,  and  (c)  time  and  expense  required 
for  travel.   Next,  a  stratified,  random  sample  of  the 
beginning  teachers  from  the  chosen  districts  was  selected. 
The  population  was  stratified  by  university  and  type  of 
preservice  teacher  education  program  (i.e.,  special  and 
general  education) .   The  beginning  teachers  in  the  random 
sample  were  sent  a  letter  that  included  a  brief  explanation 
of  the  study  and  a  postcard  to  return  if  they  would  like  to 
participate  (see  Appendix  D) .   Their  permission  was  obtained 
to  meet  the  University  of  Florida  Institutional  Review  Board 
regulations  (Committee  for  the  Protection  of  Human  Subjects) 
(see  Appendix  E) . 

The  number  of  postcards  returned  did  not  result  in  an 
adequate  sample  size;  therefore,  follow-up  phone  calls  were 
made  to  enlist  more  participation.   Telephone  contact  with 
beginning  teachers  also  provided  the  opportunity  to  determine 
typical  reasons  that  some  chose  not  to  participate.   Those 
reasons  included  (a)  the  number  of  required  observations  for 
the  beginning  teacher  program,  (b)  concern  that  their 
teaching  situations  would  not  provide  an  accurate 
illustration  of  what  typically  occurs  in  the  classroom,  and 
(c)  general  feelings  of  stress. 

Three  factors  were  considered  in  determining  the  sample 
size.   First,  the  alpha  level  was  set  at  a  conservative  level 
(.05)  so  that  the  probability  of  a  Type  I  error  (rejecting  a 
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true  null  hypothesis)  was  minimized.   Second,  without  a 
theoretical  base  from  which  to  predict  an  effect  size,  the 
effect  size  was  conservatively  estimated  to  be  between  .50 
and  .60.   Third,  power  of  .80  was  targeted  to  adequately 
detect  any  differences  between  the  two  groups.   Therefore, 
the  sample  size  of  47  was  considered  acceptable  (Shavelson, 
1988) . 

Description  of  the  Research  Instrumentation 

The  research  instrument  used  in  the  study,  Praxis  III: 
Classroom  Performance  Assessment,  is  an  assessment  system 
that  uses  three  data-collection  methods:   direct  observation 
of  classroom  practice,  written  descriptions  of  the  students 
and  what  they  are  to  learn,  and  interviews  that  are 
structured  around  the  classroom  observation.   Following  the 
postobservation  interview,  the  assessor  reviews  all  the  notes 
taken  from  the  preobservation  interview,  observation,  and 
postobservation  interview  as  well  as  the  teacher-prepared 
written  documents. 
Data  Collection  Procedures 

Evidence  is  gathered  for  each  criterion  and  may  come 
from  any  source  within  the  assessment  cycle.   The  assessor 
compiles  positive  and/or  negative  evidence  for  each 
criterion.   The  most  pertinent  evidence  is  then  selected  and 
transferred  to  the  Record  of  Evidence  form  (see  Appendix  F) . 
After  careful  consideration  of  the  evidence  for  each 
criterion,  the  assessor  writes  a  summary  statement  connecting 
the  evidence  to  the  scoring  rules  for  that  criterion.   A 
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score  is  then  assigned  for  each  criterion  based  on  the 
scoring  rules.   The  criterion  score  range  is  from  1.0  to  3.5 
with  a  score  at  each  .5  interval  (e.g.,  1.0,  1.5).   Scoring 
rules  and  scoring  matrices  for  each  criterion  can  be  found  in 
Appendix  G . 

For  each  criterion,  evidence  should  be  (a)  relevant  to 
the  criterion,  (b)  free  of  bias,  (c)  an  accurate 
representation  of  events,  and  (d)  of  sufficient  quantity  to 
support  a  judgment.  A  summary  statement  must  summarize  the 
evidence  cited,  refer  to  all  parts  of  the  scoring  rule,  and 
support  the  score  assigned. 

The  time  required  for  the  assessment  cycle  varies  for 
each  individual.   The  preobservation  interview  lasts 
approximately  20  minutes.   Following  the  interview,  a 
classroom  observation  is  conducted  that  lasts  a  class  period 
or  the  length  of  a  lesson.   The  postobservation  interview 
completes  the  cycle  and  requires  from  20  to  3  0  minutes.   One 
to  2  hours  is  required  by  the  assessor  to  score  each  domain. 
Validity  and  Reliability 

Praxis  III  was  developed  during  6  years  of  extensive 
research  by  personnel  at  the  Educational  Testing  Service 
(ETS) .   The  developers  considered  it  essential  to  articulate 
both  a  guiding  conception  of  teaching  and  learning  and  a  set 
of  criteria  by  which  beginning  teaching  could  be  assessed. 
The  guiding  conception,  discussed  in  detail  in  Chapter  II, 
clarified  the  research  and  development  effort  that  culminated 
in  the  19  Praxis  III  criteria. 
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Prior  to  determination  of  the  19  criteria,  the 
developers  identified  a  knowledge  base  from  which  to 
establish  an  initial  set  of  assessment  criteria.   The 
knowledge  base  was  derived  from  three  main  sources  of 
evidence:   practicing  teachers,  the  research/theoretical 
perspective,  and  teacher  licensing  requirements.   This  was 
done  to  consider  multiple  perspectives  rather  than  rely  on 
one  paradigm  of  effective  teaching. 

Knowledge  base.   The  first  major  source  of  information 
in  the  development  of  the  Praxis  III  assessment  consisted  of 
praciticing  teachers.   The  developers  conducted  large-scale 
studies  to  determine  important  tasks  required  of  beginning 
teaching  (see  Rosenfeld,  Freeberg,  &  Bukatko,  1992; 
Rosenfeld,  Reynolds,  &  Bukatko,  1992;  Rosenfeld,  Wilder,  & 
Bukatko,  1992) .   Surveys  were  sent  to  teachers  from 
elementary,  middle,  and  secondary  levels.   The  respondents 
were  asked  about  the  importance  of  specific  tasks  from  their 
own  teaching  as  well  as  beginning  teaching.   Further,  the 
respondents  were  asked  to  identify  other  important  aspects  of 
teaching  that  may  not  have  been  included  in  the  survey. 

The  second  source  of  information  was  a  series  of 
research  reviews.   Guided  by  a  panel  of  experts  (e.g.,  D. 
Berliner,  R.  Calfee,  L.  Delpit,  and  A.  Hilliard) ,  researchers 
reviewed  literature  on  effective  teaching,  effective 
beginning  teaching,  and  effective  teaching  in  multicultural 
classrooms.   Thus  theoretical  perspectives  and  research 
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findings  strengthened  the  knowledge  base  provided  by 
praciticing  teachers. 

The  third  source  of  evidence  for  the  knowledge  base  was 
an  analysis  of  states'  regulations  and  practices  regarding 
beginning  teacher  assessments.   Through  a  nationwide  content 
analysis  of  state  performance  assessment  requirements, 
information  was  identified  and  compiled.   Developers  focused 
on  the  requirements  related  to  the  assessment  of  actual 
teaching  rather  than  on  other  knowledge,  skill,  experience, 
or  educational  attainment . 

Criterion  development .   From  the  three  sources  described 
above,  a  knowledge  base  for  the  assessment  of  beginning 
teachers  was  formed.   The  development  team  used  this 
knowledge  base  to  draft  an  initial  set  of  assessment 
criteria.   At  this  point  a  National  Advisory  Committee 
reviewed  the  research  base  and  the  draft  assessment  criteria. 
Members  advised  the  development  team  to  bring  the  criteria 
more  in  line  with  the  guiding  conceptions  and  organizing 
framework.   The  team  then  developed  several  revised  versions 
of  the  assessment  criteria  and  conducted  small-scale  pilot 
studies  to  test  their  effectiveness  in  actual  teaching 
situations.   From  these  studies,  the  criteria  and  the 
assessment  process  underwent  extensive  changes.   Large-scale 
fieldwork  was  then  conducted  to  further  refine  criteria. 
During  this  phase  of  the  research  process,  scoring  rules  were 
developed  and  clarified  by  collaborating  teachers  and 
researchers .   Concurrent  with  the  refinement  of  the 
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assessment  criteria,  field  studies  also  focused  on  assessor 
training.   Several  modifications  were  made  to  clarify 
particular  scoring  rules  and  enhance  note  taking,  coding,  and 
use  of  multiple  sources  of  evidence.   Additional  assessors 
were  then  trained  using  the  finalized  version  of  the  Praxis 
III  assessment  system.   A  more  complete  description  of  the 
process  of  developing  the  criteria  and  the  knowledge  base  for 
each  of  the  19  assessment  criteria  can  be  found  in  Dwyer 
(1994)  . 

A  preliminary  analysis  of  data  collected  during  field 
testing  indicated  a  moderate  to  high  level  of  inter-rater 
agreement  between  paired  assessors  who  observed  the  same 
teaching  event  (Dwyer,  1994).   To  date,  no  inter-rater 
reliability  data  have  been  published.   ETS  does  not  emphasize 
inter-rater  reliability;  rather  they  stress  the  importance  of 
using  certified  assessors.   Ultimately,  therefore,  the 
validity  of  Praxis  III  rests  on  the  rigor  of  the  assessor 
training  (Klem,  personal  communication,  1994;  Villegas, 
1992)  . 

Description  of  the  Procedures 
Assessment  Cycle 

The  collection  of  data  for  this  study  was  conducted 
through  an  interactive  process  consisting  of  the  four  phases 
of  Praxis  III:   preobservation  interview,  classroom 
observation,  postobservation  interview,  and  recording/scoring 
of  evidence.   This  set  of  phases  is  referred  to  as  an 
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assessment  cycle  and  was  conducted  for  each  beginning 
teacher . 

Preobservation  interview.   Prior  to  the  preobservation 
interview,  the  assessor  provided  each  teacher  with  three 
forms  to  complete:   Candidate  Profile  (see  Appendix  C) ,  Class 
Profile  (see  Appendix  H) ,  and  Instruction  Profile  (see 
Appendix  I) .   These  forms  supplied  written  documentation  to 
convey  a  sense  of  the  general  classroom  context  and 
characteristics  of  the  students  in  the  class,  as  well  as 
specific  information  about  the  lesson  to  be  observed.   The 
written  documentation  included  a  sketch  of  the  classroom  and 
a  seating  chart  to  facilitate  the  questioning  during  the 
interview.   The  purpose  of  the  semi-structured, 
preobservation  interview  was  to  provide  insight  into  the 
teacher's  planning  for  the  observed  lesson.   The  assessor 
asked  a  series  of  questions  related  to  the  Class  Profile, 
Instruction  Profile,  and  the  planned  lesson.   Questions 
allowed  for  a  free-flow  response  from  the  teacher  (see 
Appendix  J) .   Notes  were  recorded  by  the  assessor  using  a 
laptop  computer. 

Classroom  observation.   During  the  observation  of  the 
planned  lesson,  the  assessor  transcribed  an  account  of  the 
unfolding  events  using  a  laptop  computer.   Teacher  behavior, 
student  behavior,  and  teacher-student  interaction  during  the 
lesson  was  recorded.   Summary  statements  restricted  to 
observable  behavior  were  allowed.   During  this  phase,  no 
judgments  or  interpretations  were  made. 
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Postobservation  interview.   The  postobservation 
interview  was  conducted  as  soon  after  the  planned  lesson  as 
possible.   The  purpose  of  this  interview  was  to  allow  for 
exploration  of  the  teacher's  rationales  for  his  or  her 
decisions  and  practices  as  well  as  an  opportunity  for 
reflection  on  his  or  her  teaching  practice.   The  assessor's 
questions  produced  free-flow  responses  from  the  subjects  (see 
Appendix  K) .   Again,  laptop  computers  were  used  for  taking 
notes . 

Recording/scoring  of  evidence.   Following  the  data 
collection,  the  assessor  analyzed  the  data  from  all  of  the 
sources.   After  a  thorough  analysis,  the  assessor  evaluated 
the  beginning  teacher  using  a  set  of  specific  criteria  and 
scoring  rules  to  procure  ratings  for  each  of  the  criteria. 
Assessors  supported  their  professional  judgments  by  citing 
specific  evidence  for  their  ratings. 
Assessor  Training 

Following  intensive  training  by  ETS  personnel,  each 
assessor  was  able  to  document  a  teacher's  performance  and  to 
interpret  and  score  collected  data  accurately  in  a  wide 
variety  of  classroom  contexts.   The  degree  of  accuracy  was 
determined  by  how  close  the  assessors'  ratings  were  to  the 
preestablished  scores.   Assessor  training  consisted  of  5  days 
of  highly  interactive  instruction  using  a  wide  range  of 
stimuli  such  as,  videotapes,  simulations,  and  printed 
materials  (e.g.,  sample  records  of  evidence).   Throughout  the 
training,  participants  receive  feedback  from  the  instructor, 
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other  participants,  and  answer  keys  of  the  exercises.   After 
4  days  of  training,  assessors  conducted  a  field  test  of  the 
assessment  system,  then  returned  for  a  fifth  day  of  targeted 
skill  reinforcement  and  consolidation.   During  their  final 
session,  assessors  demonstrated  competency  on  an  assessor 
proficiency  test.   Competency  was  judged  by  how  close  the 
assessors'  ratings  were  to  the  preestablished  scores.   This 
test  was  performance-based  and  allowed  assessors  to 
demonstrate  the  entire  range  of  assessment  activities  that 
they  will  encounter  in  practice. 

Assessors  were  specifically  instructed  that  there  is  a 
wide  range  of  acceptable  teaching  styles  that  may  or  may  not 
match  their  own  teaching  preferences.   Furthermore,  training 
personnel  emphasized  the  importance  of  including  documented 
information  about  the  classroom  context  into  the  ratings.   In 
particular,  assessors  were  trained  not  to  penalize  teachers 
in  difficult  teaching  situations  for  circumstances  beyond 
their  control . 

Both  assessors  used  in  this  study  were  trained  at  the 
same  time  by  ETS  personnel.   Several  of  those  involved  in 
training  the  assessors  were  also  involved  in  the  development 
of  the  instrument .   Each  of  the  assessors  was  a  doctoral 
student  in  the  College  of  Education  at  the  University  of 
Florida  and  each  had  gained  some  experience  with  Praxis  III 
prior  to  collecting  data  for  this  study. 
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Treatment  of  the  Data 
The  major  research  question  was  to  determine  whether 
there  was  significant  differences  between  the  two  groups  of 
teachers  on  all  19  criteria  of  Praxis  III.   Because  the 
domains  of  Praxis  III  and  their  corresponding  criteria  were 
designed  to  be  interrelated  to  mirror  the  integrated  nature 
of  teaching,  these  19  measures  are  not  assumed  to  be 
statistically  independent  of  each  other  (Dwyer,  1994).   Thus, 
a  one-way,  between-groups  multivariate  analysis  of  variance 
(MANOVA)  was  used  to  test  the  hypothesis.   Because  the  MANOVA 
indicated  a  significant  difference  between  the  two  groups,  a 
series  of  one-way  analysis  of  variances  (ANOVAs)  were 
conducted  for  each  criterion. 


CHAPTER  IV 
RESULTS 

Introduction 

The  purpose  of  this  study  was  to  investigate  the  effects 
of  teacher  preparation  on  the  classroom  performance  of 
beginning  teachers  (special  and  general  education)  in  several 
key  areas:   (a)  organizing  content  knowledge  for  student 
learning,  (b)  creating  an  environment  for  student  learning, 
(c)  teaching  for  student  learning,  and  (d)  teacher 
professionalism.   The  general  question  of  the  study  was  as 
follows:   Do  beginning  special  education  teachers  differ  from 
beginning  general  education  teachers  in  their  classroom 
performance?  To  investigate  this  question,  the  classroom 
performance  of  beginning  special  education  teachers  was 
compared  to  the  performance  of  beginning  general  education 
teachers . 

To  determine  the  effects  of  teacher  preparation  on 
classroom  performance,  observations  using  Praxis  III  were 
conducted  on  25  special  education  teachers  and  22  general 
education  teachers  who  had  graduated  from  four  state 
universities  in  Florida:   University  of  Florida  (UF) ,  Florida 
State  University  (FSU) ,  University  of  Central  Florida  (UCF) , 
and  University  of  South  Florida  (USF) .   All  of  the  teachers 
in  both  groups  taught  at  the  elementary  level  and  were  in 
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their  first  year  of  teaching.   This  chapter  contains  the 
results  of  the  statistical  analyses  of  data  from  this  study. 
Comparison  of  Demographic  Characteristics 

The  data  were  analyzed  to  determine  if  any  differences 
existed  between  the  teacher  preparation  groups  (general  and 
special  education)  on  any  of  the  measures.   This  section 
includes  a  description  of  the  analyses  and  the  results. 

Table  1  shows  the  demographic  distribution  of  study 
participants  in  the  two  groups.   Chi-square  analyses  were 
completed  to  determine  if  there  were  any  preexisting 
differences  between  the  two  groups  of  teachers  with  respect 
to  gender,  age,  race,  and  university. 

The  chi-square  tests  revealed  no  statistically 
significant  differences  between  special  education  teachers 
and  general  education  teachers.   The  majority  of  both  groups 
were  female  (96%  and  86%  respectively  for  special  and  general 
education  teachers) .   Among  the  special  education  teachers, 
84%  were  under  34  years  of  age  and  91%  of  the  general 
education  teachers  were  in  this  age  group.   All  (100%)  of  the 
special  education  teachers  and  95%  of  the  general  education 
teachers  were  white.   The  distribution  by  university  was 
nearly  even  as  exhibited  by  the  chi-square  and  associated  p- 
value  of  0.985.   Therefore,  the  two  groups  are  comparable 
with  respect  to  age,  gender,  race,  and  university  attended. 
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Table  1 

Distribution  of  Participants  by  Demographic  Characteristics 
Special  Education    General  Education 


Gender 

Female             24  96         19         86 

Male               1  4          3         14 

(Chi-square  =  1.396,  1,  p  =  0.237) 

Age 

<25 

25-34 

35-44 

45-54 

(Chi-square  =  2.29S 

Race 

White  25 

Black  0 

(Chi-square  =  1.161,  1,  p 

University 

UF 

FSU 

UCF 

USF 

(Chi-square  =  0.150,  3,  p 

Total 25 100% 22 100? 


10 

40 

13 

59 

11 

44 

7 

32 

3 

12 

2 

9 

1 

4 

0 

0 

,  3, 

P  = 

:  0.513) 

100 

21 

95 

0 

1 

5 

0.281) 

9 

36 

7 

32 

4 

16 

4 

18 

6 

24 

6 

27 

6 

24 

5 

23 

,  3,  p 

=  0.985) 

63 


Criterion  and  Domain  Scores 
The  means  and  standard  deviations  of  the  19  criterion 
scores  and  domain  scores  were  calculated  for  each  group. 
These  figures  are  presented  in  Tables  2-6. 


Table  2 

Summary  of  Domain  Scores  by  Group 


Spec 

ial  Educators 

(n=25) 

General  Educators 

(n=22) 

Domain 

Mean 
(Std.  Dev.) 

Mean 
(Std.  Dev.) 

A 

11.58 
(2.03) 

11.52 
(1.57) 

B 

13.80 
(1.60) 

12.50 
(1.78) 

C 

12.20 
(1.68) 

12.27 
(2.16) 

D 

10.04 
(1.31) 

10.02 
(1.48) 

Table  3 

Summary  of  Domain  A  Criterion  Scores  by  Group 


Spec 

ial  Educators 

(n=25) 

General  Educators (n=22) 

Criterion 

Mean 
(Std.  Dev.) 

Mean 
(Std.  Dev.) 

Al 

2.64 
(.511) 

2.52 

(.475) 

A2 

2.28 
(.678) 

2.00 
(.672) 

A3 

2.02 
(.489) 

2.43 

(.541) 

A4 

2.66 
(.494) 

2.50 
(.345) 

A5 

1.98 
(.568) 

2.09 
(.453) 
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Table  4 

Summary  of  Domain  B  Criterion  Scores  by  Group 


Spec 

ial  Educators (n= 
Mean 

=  25) 

General  Educators (n=22) 
Mean 

Criterion 

(Std.  Dev.) 

(Std.  Dev.) 

Bl 

2.64 
(.468) 

2.20 
(.630) 

B2 

2.82 
(.518) 

2.57 
(.541) 

B3 

2.56 
(.565) 

2.25 

(.668) 

B4 

3.10 
(.289) 

2.59 
(.590) 

B5 

2.68 
(.430) 

2.89 
(.342) 

Table  5 

Summary  of  Domain  C  Criterion  Scores  bv  Group 

Special  Educators (n=2 5)   General  Educators (n=22) 


Criterion 


Mean 
(Std.  Dev.) 


Mean 
(Std.  Dev.) 


CI 

2.40 

2.34 

(.577) 

(.679) 

C2 

2.52 

2.43 

(.586) 

(.642) 

C3 

1.80 

2.30 

(.479) 

(.718) 

C4 

2.78 

2.59 

(.435) 

(.549) 

C5 

2.70 

2.61 

(  .408) 

( .533) 
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Table  6 

Summary  of  Domain  D  Criterion  Scores  by  Group 


Special  Educators 

(n=25) 

General 

Educators (n=22) 

Mean 

Mean 

Criterion 

(Std.  Dev.) 

( 

Std.  Dev.) 

Dl 

2.42 
(.687) 

2.25 

(.783) 

D2 

2.52 
(.510) 

2.45 
(.533) 

D3 

2.56 
(.464) 

2.93 
(.417) 

D4 

2.54 
(.431) 

2.39 

(.435) 

Test  of  Hypothesis 

A  one-way,  between-groups  multivariate  analysis  of 
variance  (MANOVA)  was  used  to  test  the  hypothesis  that  there 
would  be  no  differences  between  the  groups  on  the  19 
criteria.   The  MANOVA  revealed  significant  differences 
between  groups  on  at  least  one  variable  [Hotelling's  £(19,27) 
=  2.791,  E  =  0.001] . 

Based  on  the  results  of  Hotelling's  MANOVA  (p_<0.05),  the 
mull  hypothesis  was  rejected.   Special  education  teachers 
differed  from  general  education  teachers  on  at  least  one  of 
the  criteria. 

To  determine  which  criteria  were  the  sources  of  the 
differences  between  special  education  and  general  education 
teachers,  one-way  analyses  of  variance  (ANOVAs)  were 
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conducted  for  each  criterion.  Table  7  shows  the  results  of 
these  analyses . 

Table  7 

Summary  of  Univariate  Analysis  of  Variance  for  19  Criteria 

Dependent        F  df  p 

Measure 

Al                0.66  1,45  .421 

A2                2.01  1,45  .163 

A3                7.51  1,45  .009* 

A4                1.61  1,45  .211 

A5                0.54  1,45  .467 

Bl               7.35  1,45  .009* 

B2               2.65  1,45  .110 

B3                2.97  1,45  .092 

B4               14.65  1,45  .000* 

B5                3.25  1,45  .078 

CI                0.10  1,45  .749 

C2                0.24  1,45  .625 

C3                7.92  1,45  .007* 

C4               1.73  1,45  .195 

C5               0.39  1,45  .533 

Dl                0.63  1,45  .432 

D2                0.19  1,45  .669 

D3                8.27  1,45  .006* 

D4 1.48 1,45 .231 

*Significant  at  the  e<.05  level. 
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Sources  of  Significant  Differences 
The  data  collected  through  the  interviews  and 
observations,  as  documented  on  the  Records  of  Evidence,  were 
used  to  establish  the  scores  for  each  criterion  within  Praxis 
III.   The  criteria  on  which  significant  differences  between 
groups  were  obtained  are  described  in  this  section.   Examples 
of  teacher  responses  and  behaviors  are  provided. 
Criterion  A3 

Criterion  A3  measured  the  teachers'  ability  to 
demonstrate  an  understanding  of  the  connections  between  the 
content  that  was  learned  previously,  the  current  content,  and 
the  content  that  remains  to  be  learned  in  the  future. 
General  education  teachers  scored  significantly  higher  than 
special  education  teachers  on  this  criterion. 

General  education  teachers  tended  to  explain  accurately 
how  the  content  of  the  current  lesson  related  to  the  content 
of  previous  and  future  lessons,  and  they  were  also  able  to 
explain  how  the  current  lesson  fits  within  the  structure  of 
the  discipline.   As  a  group,  special  education  teachers  were 
less  able  to  explain  how  the  current  lesson  fits  within  the 
larger  goals  of  learning  in  the  discipline.   For  example,  in 
a  preobservation  interview  question  about  the  organization  of 
the  subject  or  discipline,  one  general  education  teacher 
provided  a  detailed  explanation  of  how  the  observed  lesson  on 
planets  and  their  order  from  the  sun  directly  related  to  a 
unit  on  astronomy  that  included  stars,  galaxies,  and  solar 
systems.   Given  the  same  preobservation  question,  one  special 
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educator  responded  by  relating  the  current  reading  lesson  to 
prior  lessons  in  which  students  learned  letter  names  and 
sounds . 
Criterion  Bl 

Criterion  Bl  examines  the  teachers'  creation  of  a 
climate  that  promotes  fairness.   Special  education  teachers 
scored  significantly  higher  than  general  education  teachers 
on  this  criterion. 

Special  education  teachers  tended  to  be  fair  in  their 
treatment  of  and  attention  to  students  and  actively 
encouraged  fairness  among  students  during  lesson 
observations.   For  example,  during  the  classroom  observation, 
one  special  educator  responded  quickly  to  demeaning 
statements  made  by  a  student .   The  teacher  encouraged  the 
students  to  show  respect  for  each  other  by  not  using  unfair 
statements.   Many  general  education  teachers  restricted  equal 
access  to  learning  by  overattending  to  certain  students  in 
the  class  and  excluding  others  during  student-teacher 
interactions.   For  example,  one  general  educator  consistently 
ignored  students  who  were  off-task  without  attempting  to 
reengage  them  in  the  lesson. 
Criterion  B4 

Criterion  B4  focuses  on  establishing  and  maintaining 
consistent  standards  of  classroom  behavior.   Special 
education  teachers  scored  significantly  higher  than  general 
education  teachers  on  this  criterion. 
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During  classroom  observations,  special  education 
teachers  tended  to  respond  to  minor  misbehavior  consistently 
and  they  experienced  reasonable  success  in  reducing  those 
behaviors.   For  example,  several  special  educators  responded 
to  students  calling  out  answers  by  reminding  them  of  the  rule 
and  reinforcing  those  students  that  responded  appropriately. 
In  contrast,  general  education  teachers  tended  to  respond 
inconsistently  to  minor  misbehavior  and  had  less  success  in 
reducing  those  behaviors.   For  example,  several  general 
educators  corrected  the  inappropriate  behavior  of  students  in 
some  instances,  while  allowing  the  same  behavior  to  occur 
uncorrected  at  other  times. 
Criterion  C3 

Criterion  C3  examined  the  methods  teachers  use  to  extend 
student  thinking.   General  education  teachers  scored 
significantly  higher  than  special  education  teachers  on  this 
criterion. 

General  education  teachers  tended  to  use  activities  that 
were  specifically  designed  to  encourage  students  to  think 
independently,  creatively,  or  critically  about  the  lesson 
content.   These  activities  promoted  the  extension  of  student 
thinking  beyond  the  current  lesson.   For  example,  one  general 
education  teacher  conducted  a  lesson  on  letter  writing.   The 
teacher  designed  a  learning  activity  in  which  students  would 
write  a  letter  to  themselves.   The  students  were  to  write 
about  (a)  what  they  were  looking  forward  to  the  next  school 
year,  (b)  what  they  would  miss  most  about  fifth  grade,  and 
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(c)  what  they  saw  themselves  doing  in  the  year  2002,  after 
graduation.   The  teacher  planned  to  send  the  letters  to  her 
students  in  the  year  2002.   This  lesson  required  students  to 
think  creatively  about  their  lives  in  the  present  and  future. 

Special  education  teachers  were  more  likely  to  encourage 
students  to  think  independently,  creatively,  or  critically, 
but  this  only  occurred  within  the  existing  context  of  the 
lesson.   Some  of  the  techniques  that  special  educators  used 
during  the  observed  lessons  included  asking  open-ended 
questions  and  making  predictions  about  story  outcomes . 
Criterion  D3 

The  focus  of  Criterion  D3  was  the  building  of 
professional  relationships  with  colleagues  to  share  teaching 
insights  and  to  coordinate  learning  activities  for  students. 
General  education  teachers  scored  significantly  higher  than 
special  education  teachers  on  this  criterion. 

General  education  teachers  tended  to  demonstrate 
knowledge  of  available  resources  and  to  consult  with 
colleagues  on  matters  related  to  student  learning.   They  also 
collaborated  frequently  with  other  teachers  to  coordinate 
learning  activities  for  their  students .   General  educators 
were  likely  to  work  with  other  teachers  on  their  grade  level 
as  well  as  teachers  from  other  grade  levels. 

Special  educators  also  demonstrated  knowledge  of 
available  resources  and  consulted  with  colleagues  on  matters 
related  to  student  learning,  but  they  were  less  likely  to 
collaborate  with  colleagues  to  coordinate  learning 
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activities.   Several  special  education  teachers  noted  that 
the  isolated  and  specialized  nature  of  their  job  contributed 
to  their  lack  of  opportunities  for  frequent,  informal 
collaboration. 

Summary 

The  purpose  of  this  study  was  to  determine  the  effects 
of  teacher  preparation  on  classroom  performance  of  beginning 
teachers  in  general  and  special  education.   The  dependent 
measures  were  the  19  criteria  on  an  instrument  designed  to 
assess  beginning  teachers  for  licensure,  PRAXIS  III: 
Classroom  Performance  Assessment . 

A  MANOVA  was  used  to  test  the  following  null  hypothesis: 
There  will  be  no  statistically  significant  difference  between 
the  groups  on  measures  of  classroom  performance. 
Significant  differences  between  special  and  general  education 
teachers  were  detected,  which  resulted  in  the  rejection  of 
the  null  hypothesis.   These  differences  were  detected  on  5  of 
the  19  criteria  on  Praxis  III.  General  educators  scored 
significantly  higher  on  measures  of  Criterion  A3,  C3 ,  and  D3 . 
Special  educators  score  significantly  higher  on  measures  of 
Criterion  Bl  and  B4 .   The  implications  of  these  results  are 
discussed  in  Chapter  V. 


CHAPTER  V 
DISCUSSION 


The  purpose  of  this  study  was  to  examine  the  effects  of 
teacher  preparation  on  the  classroom  performance  of  beginning 
teachers  in  general  and  special  education.   Several  key 
domains  of  classroom  performance  were  examined:   (a) 
organizing  content  knowledge  for  student  learning,  (b) 
creating  an  environment  for  student  learning,  (c)  teaching 
for  student  learning,  and  (d)  teacher  professionalism.   One 
hypothesis  was  formulated  and  tested.   The  general  question 
of  the  study  was  as  follows:   Does  teacher  preparation  in 
general  education  or  special  education  affect  the  classroom 
performance  of  beginning  teachers?  To  determine  these 
effects,  observations  using  Praxis  III:   Classroom 
Performance  Assessment  were  conducted. 

Overview  of  Research  Findings 

In  this  section,  the  null  hypothesis  is  reviewed,  along 
with  the  findings.   An  explanation  of  the  relationship 
between  the  hypothesis  and  the  respective  domains  and 
criteria  of  Praxis  III  is  provided. 

The  19  criteria  of  Praxis  III  were  used  to  test  the 
hypothesis  that  there  is  no  statistically  significant 
difference  between  beginning  special  education  and  beginning 
general  education  teachers  on  measures  of  classroom 

72 


73 

performance.  Significant  differences  were  indicated  between 
the  two  groups;  therefore,  the  null  hypothesis  was  rejected. 
These  differences  were  detected  on  five  criteria. 

In  Domain  A,  organizing  content  knowledge  for  student 
learning,  general  educators  scored  significantly  higher  than 
special  educators  on  the  criterion  (Criterion  A3)  that 
related  to  the  teacher's  ability  to  demonstrate  an 
understanding  of  the  connections  between  the  content  that  was 
learned  previously,  the  current  content,  and  the  content  that 
remains  to  be  learned  in  the  future.   On  measures  of  creating 
an  environment  for  student  learning,  Domain  B,  special 
educators  scored  significantly  higher  than  general  educators 
on  the  criterion  (Criterion  Bl)  that  related  to  the  creation 
of  a  climate  that  promotes  fairness.   Special  educators  also 
scored  significantly  higher  than  general  educators  on  the 
criterion  (Criterion  B4)  that  related  to  establishing  and 
maintaining  consistent  standards  of  classroom  behavior. 

In  Domain  C,  teaching  for  student  learning,  general 
educators  scored  significantly  higher  than  special  educators 
on  the  criterion  (Criterion  C3)  that  related  to  encouraging 
students  to  extend  their  thinking.   On  measures  of  teacher 
professionalism,  Domain  D,  general  educators  scored 
significantly  higher  than  special  educators  on  the  criterion 
(Criterion  D3)  that  related  to  building  professional 
relationships  with  colleagues  to  share  teaching  insights  and 
to  coordinate  learning  activities  for  students. 


74 

Implications  of  the  Research  Findings 
Teacher  development  theory  was  applied  to  this  study  to 
increase  understanding  of  the  initial  stage  of  teacher 
development.   The  following  sections  contain  (a)  theoretical 
implications,  (b)  implications  for  beginning  teacher 
knowledge  base,  and  (c)  implications  for  teacher  education. 
Theoretical  Implications 

Although  teachers  appear  to  progress  through  several 
stages  of  development  in  the  process  of  becoming  a  competent 
teacher,  these  stages  are  characterized  by  a  variety  of 
behaviors.   During  a  stage  of  development,  a  teacher  may 
exhibit  a  wide  range  of  competency  in  classroom  behaviors  and 
skills.   This  range  of  skills  may  be  one  reason  for  the  lack 
of  clarity  in  the  descriptions  of  the  developmental -stage 
models  (Burden,  1990).   Praxis  III  may  provide  teacher 
development  theorists  with  clearer  descriptions  of  the 
various  characteristics  of  beginning  teacher  development. 

Results  of  this  study  indicate  that,  while  all  of  the 
teachers  appeared  to  be  in  the  initial  stage  of  teaching 
(survival) ,  some  teaching  behaviors  and  skills  were  different 
for  the  two  groups.   For  example,  special  education  teachers 
in  this  study  exhibited  strengths  in  establishing  and 
maintaining  consistent  standards  of  behavior  in  contrast  to 
the  expectation  of  beginning  teacher  performance  established 
by  teacher  development  theory.   Clearly,  the  differences  in 
preparation  of  the  special  education  teachers  contributed  to 
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this  finding,  but  the  theory  of  teacher  development  does  not 
consider  preparation  other  than  general  education. 

One  responsibility  of  university  field  supervisors  and 
school  administrators  is  to  help  preservice  and  inservice 
teachers  improve  their  instruction  by  facilitating  their 
development.   With  knowledge  of  the  theory  of  teacher 
development,  supervisors  could,  perhaps,  become  more 
effective  in  their  use  of  Praxis  III  as  a  tool  to  promote 
professional  growth.   Similarly,  if  these  supervisors 
understand  the  differences  in  teacher  preparation  between 
special  and  general  education,  their  ability  to  apply  teacher 
development  theory  in  practice  may  be  enhanced. 

Teacher  development  theory  characterizes  the  initial 
stage  of  teaching  as  a  survival  stage.   Teachers  in  this 
stage  tend  to  (a)  have  difficulty  with  curriculum 
development,  (b)  struggle  with  evaluation  of  student 
progress,  and  (c)  be  more  concerned  with  their  own 
performance  than  with  student  learning  (Burden,  1990).   The 
evidence  from  classroom  observations  and  interviews  indicates 
that  both  groups  exhibited  characteristics  of  this  initial 
stage.   Therefore,  the  findings  of  this  study  support 
generalizations  of  teacher  development  theory  to  include 
beginning  special  education  teachers. 
Implications  for  Beginning  Teacher  Knowledge  Base 

Although  much  is  known  about  the  differences  between 
beginning  teachers  and  competent,  experienced  teachers, 
researchers  have  done  little  to  add  to  the  current  knowledge 
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base  about  competent  beginning  teachers .   The  results  of 
research  conducted  with  Praxis  III  may  assist  researcher  in 
expanding  the  knowledge  base  and  improving  our  understanding 
of  competent  beginning  teaching.   In  this  study,  the  evidence 
cited  from  interviews  and  observations  supports  the  current 
beginning  teacher  literature.   Specific  examples  of  teacher 
behaviors  and  responses  are  provided  and  grouped  by  three 
phases  of  teaching. 

Preactive.   When  planning  their  lessons,  both  groups  of 
beginning  teachers  rarely  took  into  consideration  their 
students'  background  experiences,  prior  skills,  and 
developmental  levels.   In  choosing  goals  for  these  lessons, 
general  and  special  education  teachers  seldom  provided  a 
thoughtful  explanation  of  why  the  goals  were  appropriate  for 
all  students  nor  did  they  differentiate  these  goals  for 
groups  or  individual  students  in  the  class  (Brophy  &  Good, 
1986;  Peterson,  Marx,  &  Clark,  1978) .   Both  groups  of 
teachers  were  also  unlikely  to  choose  methods  and  activities 
that  allowed  for  differentiated  learning  experiences  nor  did 
they  provide  an  explanation  of  why  the  method  or  activity 
chosen  was  appropriate  to  all  students. 

One  of  the  lowest  mean  scores  for  both  groups  of 
teachers  was  on  their  ability  to  create  or  select  evaluation 
strategies  that  are  appropriate  for  students  and  aligned  with 
the  goals  of  the  lesson.   Many  teachers  either  had  not 
provided  a  plan  for  systematic  evaluation  of  student  learning 
or  had  selected  a  plan  that  was  clearly  inappropriate  to  the 
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goals  of  the  lesson  (Porter  &  Brophy,  1988;  Zigmond,  Sansone, 
Miller,  Donahoe,  &  Kohnke,  1986).   None  of  the  teachers  in 
this  study  described  how  he  or  she  would  use  the  results  of 
the  evaluation  in  planning  future  instruction.   These 
similarities  between  the  two  groups  of  teachers  supports 
previous  research  that  beginning  teachers  are  less  apt  to 
consider  student  differences  and  subject  matter  in  their 
planning  and  are  often  inconsistent  in  their  evaluation  of 
student  progress . 

Interactive.   Most  evidence  of  teaching  tasks  in  the 
interactive  phase  was  detected  during  the  observation.   When 
managing  the  learning  environment,  special  education  teachers 
were  very  likely  to  be  consistent  in  maintaining  and 
establishing  rules  and  routines.   This  evidence  contradicts 
several  beginning  teacher  studies  that  report  beginning 
teachers  generally  have  difficulty  with  maintaining 
consistent  standards  of  behavior  (Doyle,  1986) .   In  fact, 
both  groups  of  teachers  demonstrated  competence  with 
establishing  rapport  with  students  and  maintaining  a  safe 
environment.   In  addition,  special  education  teachers  were 
likely  to  demonstrate  fairness  in  their  interactions  with 
students.   Perhaps,  teacher  education  programs  in  Florida, 
particularly  special  education  teacher  education  programs, 
emphasize  the  importance  of  creating  a  learning  environment 
more  than  programs  in  other  areas  of  the  country. 

When  presenting  subject  matter,  both  groups  of  teachers 
were  less  likely  to  provide  students  with  clear  information 
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about  the  learning  goals,  either  explicitly  or  implicitly. 
They  often  used  general  statements  to  begin  their  lessons, 
for  example,  a  general  education  teacher  stated,  "This  is 
math.   We  are  going  to  review  some  of  the  things  we  did 
yesterday  and  the  day  before."   In  this  particular  case,  the 
learning  goals  was  for  students  to  demonstrate  an 
understanding  of  basic  concepts  in  fractions  (e.g.,  least 
common  multiple,  greatest  common  factor) .   In  their  attempts 
to  make  the  content  of  the  lesson  comprehensible  to  students, 
teachers  form  both  groups  experienced  difficulty  linking  a 
concept  to  related  concepts,  which  is  consistent  with 
previous  findings  by  Borko  and  Livingston  (1989) .   Further, 
many  of  the  teachers  did  not  make  instructional  adjustments 
based  on  their  monitoring  of  student  understanding.   These 
teachers  tended  to  use  feedback  with  students  that  was  not 
specific  and  substantive.   For  example,  some  special  and 
general  education  teachers  only  used  statements  like  "Right," 
"That's  good,"  and  "No,  that's  not  right."   One  general 
education  teacher  provided  little  assistance  to  a  groups  of 
students  who  had  missed  the  previous  day's  lesson  that  was 
essential  to  the  understanding  and  completion  of  the  observed 
lesson.   This  teacher  made  not  attempt  to  adjust  the  learning 
activity  even  thought  it  was  evident  that  the  students  were 
not  on  track.   This  evidence  supports  previous  findings  by 
Reynolds  (1992)  that  beginning  teachers  are  typically 
ineffective  in  questioning  strategies  and  tend  not  to  use 
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this  information  about  student  understanding  to  improve  their 
teaching  during  the  lesson. 

Postactive .   Teachers'  responses  during  the 
postobservation  conference  provided  evidence  to  support 
previous  research  on  beginning  teacher  reflection  of  a  lesson 
(Reynolds,  1992).   Both  groups  of  teachers  had  difficulty 
focusing  their  reflections.   When  asked  to  reflect  on  the 
extent  to  which  the  learning  goals  were  met,  the  teachers 
often  responded  with  statements  about  student  participation 
and  ease  of  presentation.   The  teachers  had  difficulty 
describing  the  strengths  and  weaknesses  of  the  lesson  in 
relation  to  the  learning  goals  and  student  understanding. 
Moreover,  teachers  from  both  groups  rarely  supported  their 
judgments  with  specific  evidence  from  the  observed  lesson. 

Although  little  research  is  available  on  the  connection 
between  teaching  and  other  professional  tasks,  such  as 
collaborating  with  colleagues,  Domain  D  of  Praxis  III  does 
begin  to  shed  some  light  on  how  these  professional  tasks  may 
relate  to  teaching.   Both  groups  of  teachers  demonstrated 
knowledge  of  school  resources  available  to  them  and 
frequently  consulted  with  colleagues  on  matters  related  to 
their  students  and  instruction.   Additionally,  all  teachers 
demonstrated  knowledge  of  forms  of  parental  communication 
that  they  used  for  various  purposes  (e.g.,  newsletters,  phone 
calls,  daily  notes,  and  conferences) . 

Blanton,  Blanton,  and  Cross  (1994)  found  that  despite 
efforts  at  the  preservice  and  inservice  level  to  increase 
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collaboration  among  teachers,  communication  between  general 
education  and  special  education  teachers  remains  infrequent 
and  possibly  inadequate.   Similar  evidence  was  found  in  this 
study.   Although  many  teachers'  responses  indicated  that 
collaboration  with  colleagues  did  occur,  the  collaboration 
tended  to  be  intradisciplinary  rather  than  interdisciplinary 
in  nature . 
Implications  for  Teacher  Education 

The  most  common  method  used  for  follow-up  studies  of 
graduates  is  the  survey  of  beginning  teachers'  perceptions  of 
the  value  of  their  preparation.   This  method,  while 
convenient  and  efficient,  may  provide  teacher  education 
programs  with  an  incomplete  picture  of  their  effectiveness. 
Teacher  educators  have  found  that  these  data  often  present  a 
fragmented  picture  regarding  graduates'  perceptions. 
Further,  researchers  have  noted  that  perceptions  of 
preparation  by  first-year  teachers  are  unstable  during  the 
first  year  of  teaching  (Adams,  1987). 

The  purpose  of  program  evaluation  should  be  to  develop 
an^J  understanding  of  the  relationships  among  a  program's 
contexts,  inputs,  processes,  and  products  (Galluzzo  &  Craig, 
1990).   Currently,  the  missing  piece  in  this  understanding  is 
the  product—graduates '  performance  in  the  field--an  area 
seldom  evaluated  by  teacher  preparation  programs.   Research 
that  focuses  on  beginning  teachers'  behaviors  and  skills  can 
provide  details  about  the  unique  needs,  strengths,  and 
problems  of  first -year  teachers.   The  more  teacher  educators 
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understand  these  experiences  the  more  capable  they  will  be  to 
make  decisions  about  the  continuation,  modification,  or 
termination  of  a  teacher  preparation  program.   Conducting 
first-year  performance  research  with  instruments  such  as 
Praxis  III  could  (a)  facilitate  communication  between  schools 
and  universities,  (b)  advance  what  is  known  about  teacher 
education,  and  (c)  raise  important  questions  about  issues  and 
practices  that  should  be  addressed. 

Given  the  recent  trend  toward  the  inclusion  of  students 
with  disabilities  in  general  classrooms,  increased  insight 
into  how  teachers  from  different  types  of  preparation 
(general  and  special  education)  perform  during  their  first 
year  of  teaching  is  important.   The  trend  toward  inclusion 
has  resulted  in  the  increased  likelihood  that  teachers  in 
general  and  special  education  will  collaborate  about  the 
needs  and  goals  of  students  with  special  needs  (Pugach  & 
Johnson,  1989) .   The  need  for  a  common  core  of  knowledge  and 
collaboration  among  discipline  is  reflected  in  the 
development  of  unified  teacher  preparation  programs  such  as 
those  at  the  University  of  Wisconsin-Milwaukee  and  the 
University  of  Cincinnati.   Knowledge  of  the  possible 
differences  in  beginning  teacher  performance  due  to 
differences  in  teacher  preparation  may  enhance  the 
collaboration  among  teacher  educators. 

General  educators  scored  significantly  higher  than 
special  educators  on  the  criterion  (Criterion  A3)  that 
related  to  the  teacher's  ability  to  demonstrate  an 
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understanding  of  the  connections  between  the  content  that  was 
learned  previously,  the  current  content,  and  the  content  that 
remains  to  be  learned  in  the  future.   Perhaps  this  difference 
is  due  to  the  emphasis  on  scope  and  sequence  of  content  areas 
in  general  education  teacher  preparation  programs.   General 
education  teachers  were  able  to  draw  on  knowledge  of  the 
subject  matter  to  explain  where  the  observed  lesson  fits 
within  the  broader  scope  of  the  discipline.   Because  special 
education  teacher  preparation  programs  traditionally  do  not 
require  multiple  courses  in  the  content  areas,  teacher 
educators  of  these  programs  may  want  to  provide  preservice 
teachers  with  several  resources  on  how  to  obtain  the 
structure  or  hierarchy  of  a  content  area. 

Special  educators  scored  significantly  higher  than 
general  educators  on  the  criterion  (Criterion  Bl)  that 
related  to  the  creation  of  a  climate  that  promotes  fairness. 
Fairness  in  this  sense  means  helping  all  students  to  have 
equal  access  to  learning  and  to  feel  equally  valued  in  the 
classroom.   Special  education  courses  often  stress  the 
importance  of  individualized  instruction,  rather  than  the 
group  process  emphasized  in  general  education  courses.   This 
difference  in  focus  may  be  why  special  education  teachers 
were  more  likely  to  assure  learning  opportunities  to  all 
students.   In  contrast,  many  general  education  teachers 
demonstrated  patterns  of  asking  or  allowing  only  some 
students  to  respond  to  questions.   Teacher  educators  in 


83 

general  education  could  illustrate  some  ways  that  the  teacher 
could  help  all  students  have  access  to  learning. 

Special  educators  also  scored  significantly  higher  than 
general  educators  on  the  criterion  (Criterion  B4)  that 
related  to  establishing  and  maintaining  consistent  standards 
of  classroom  behavior.   This  difference  is  possibly  due  to 
the  attention  behavior  management  receives  in  special 
education  teacher  preparation  programs.   Goodlad  (1993) 
reported  that  students  in  special  education  programs 
expressed  more  confidence  in  their  abilities  of  behavior 
management  than  do  students  in  general  education  programs. 
Teacher  educators  of  general  education  might  consider 
incorporating  a  course  on  classroom  management  into  their 
preparation  of  teachers.   This  could  be  accomplished  in 
collaboration  with  the  college's  department  of  special 
education. 

General  educators  scored  significantly  higher  than 
special  educators  on  the  criterion  (Criterion  C3 )  that 
related  to  encouraging  students  to  extend  their  thinking. 
Most  special  education  teachers  in  the  study  did  not  use  an 
activity  that  was  specifically  designed  to  actively  encourage 
students  to  extend  their  thinking  about  the  content  of  the 
lesson.   They  seemed  to  rely  more  on  instructional  techniques 
such  as  asking  open-ended  questions.   This  emphasis  on  low- 
level  cognitive  processes  by  special  educators  may  be  from  a 
preparation  program  that  prepares  teachers  to  focus  on  the 
basic  skills  of  reading,  math,  writing,  and  spelling. 
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Teacher  educators  in  special  education  may  want  to  assist 
preservice  teachers  in  designing  activities  or  lessons  that 
specifically  encourage  students  to  extend  their  thinking. 

General  educators  scored  significantly  higher  than 
special  educators  on  the  criterion  (Criterion  D3 )  that 
related  to  building  professional  relationships  with 
colleagues  to  share  teaching  insights  and  to  coordinate 
learning  activities  for  students.   General  education  teachers 
tended  to  consistently  coordinate  activities  with  other 
colleagues,  particularly  grade  level  team  members.   These 
results  may  be  a  product  of  either  the  school  organization 
structure,  teacher's  preparation  particularly  field 
experience,  or  a  combination  of  these  factors.   Schools  are 
most  often  organized  into  grade  levels  and  opportunities  for 
collaboration  are  abundant  for  general  education  teachers. 
In  contrast,  special  education  teachers  often  function  in 
isolation  within  schools  limiting  opportunities  for 
collaboration.   The  effect  of  teacher  preparation  on 
collaboration  of  beginning  teachers  is  probably  most 
influential  during  field  experiences.  The  field  experiences 
where  preservice  teachers  observe  the  effects  of  school 
structure  on  collaboration  may  influence  the  likelihood  of 
collaboration  efforts  in  their  future  teaching  positions. 

Limitations 

This  study  had  several  limitations.   The  most 
significant  limitation  is  the  lack  of  information  about  these 
teachers'  beliefs,  skills,  and  knowledge  prior  to  entering 
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their  teacher  preparation  program.   It  is  difficult  to  know 
what  influence  these  factors,  or  a  combination  of  these 
factors  with  preparation,  may  have  had  on  their  performance. 
Addition  ally,  the  type  of  teacher  preparation  was  self- 
selected  by  the  teachers.   That  is,  those  who  selected 
special  education  as  opposed  to  general  education  as  a  career 
may  exhibit  different  beliefs,  attitudes,  perceptions,  and 
knowledge  about  teaching. 

A  second  limitation  is  that  only  teachers  at  the 
elementary  level  were  considered  for  participation  in  the 
study.   The  results  of  this  study  may  not  be  generalized  to 
beginning  teachers  at  the  secondary  level.   This  particular 
limitation  is  consistent  with  the  limitations  of  beginning 
teacher  research  and  teacher  development  theory.   Both  bodies 
of  research  have  focused  primarily  on  elementary  school 
teachers.   Teacher  development  theorists  have  found 
significant  differences  between  elementary  and  secondary 
teachers.   For  example,  elementary  teachers  report  a  greater 
degree  of  concern  about  self,  instructional  tasks,  and 
student  impact  (Burden,  1990). 

Another  limitation  of  this  study  is  the  restricted 
geographic  location.   Observations  were  limited  to  districts 
in  Florida  and  graduates  of  state  universities  in  Florida. 
Further,  the  effects  of  the  bureaucratic  structure  of 
education  in  Florida  may  contribute  to  differences  and 
similarities.   For  example,  in  the  1991-1992  school  year 
Florida  ranked  seventh  in  the  nation  for  how  likely  districts 
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are  to  separate  students  with  disabilities  from  their  peers 
(Special  Education  Report,  1996).   The  results  may  be 
different  in  a  state  that  is  more  likely  to  serve  students 
with  disabilities  in  a  regular  classroom. 

A  fourth  limitation  of  this  study  is  voluntary 
participation  of  the  teachers.   Teachers  who  volunteer  to 
participate  in  a  study  in  which  they  are  to  be  observed  are 
more  likely  to  be  confident  in  their  teaching  abilities  and, 
perhaps,  more  likely  to  be  competent.   The  results  might  have 
been  different  given  a  truly  random  sample  of  teachers. 

Finally,  the  results  of  this  study  may  have  been 
influenced  by  the  differences  in  the  contexts  in  which 
special  and  general  educators  function.   The  teachers' 
perceptions  of  the  demands  of  their  classrooms  may  have 
affected  their  performance  and  the  aspects  of  teaching  that 
they  emphasized. 

Suggestions  for  Future  Research 

Due  to  the  lack  of  information  about  these  teachers 
prior  to  entering  their  teacher  preparation  program,  a 
longitudinal  study  may  be  warranted.   This  would  allow 
researchers  to  delineate  any  preexisting  differences  between 
the  two  groups  of  teachers . 

To  study  the  effects  of  preparation  for  content  areas, 
additional  research  with  teachers  at  the  secondary  level  is 
warranted.   Additional  studies  should  also  focus  on  graduates 
from  other  teacher  preparation  programs  and  various 
geographic  locations.   Observations  may  be  conducted  on 
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graduates  of  unified  teacher  preparation  programs  as  well. 
Although  this  type  of  research  involves  extensive  time  and 
energy  on  the  part  of  the  teacher,  researchers  should  attempt 
to  achieve  a  more  random  sample  in  future  studies,  rather 
than  limiting  the  sample  to  volunteers . 

Summary 

This  study  was  conducted  to  examine  the  effects  of  two 
types  of  teacher  preparation  on  the  classroom  performance  of 
beginning  teachers.   Teachers  were  observed  using  an 
assessment  instrument  that  was  developed  to  evaluate 
teachers'  knowledge  and  skills  in  four  domains:   organizing 
content  knowledge  for  student  learning,  creating  an 
environment  for  student  learning,  teaching  for  student 
learning,  and  teacher  professionalism. 

Special  education  teachers  scored  significantly  higher 
on  criteria  related  to  creating  an  environment  for  student 
learning:   creating  a  climate  that  promotes  fairness  and 
establishing  and  maintaining  consistent  standards  of 
classroom  behavior.   General  education  teachers  scored 
significantly  higher  on  criteria  related  to  organizing 
content  knowledge,  teaching  for  student  learning,  and  teacher 
professionalism.   These  criteria  included  (a)  demonstration 
of  an  understanding  of  the  connections  between  the  content 
that  was  learned  previously,  the  current  content,  and  the 
content  that  remains  to  be  learned  in  the  future,  (b) 
encouraging  students  to  extend  their  thinking,  and  (c) 
building  professional  relationships  with  colleagues  to  share 
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teaching  insights  and  to  coordinate  learning  activities  for 
students . 

These  findings  hold  several  implications  for  teacher 
development  theory  and  the  knowledge  base  on  beginning 
teaching.   Reynolds  (1992)  asserted  that  assessment  of 
competent  beginning  teaching  should  exceed  the  research  on 
effective  beginning  teaching  and  the  research  on  learning  to 
teach.   Praxis  III  accomplishes  this  goal  by  reflecting  the 
view  of  teachers  as  professionals,  by  representing  the 
complexity  of  teaching  and  learning,  and  by  promoting  equity 
among  all  teachers  and  students.   The  use  of  Praxis  III  in 
this  study  revealed  that  the  development  of  general  and 
special  education  teachers  is  somewhat  different  and  does  not 
fit  neatly  into  stages  of  teacher  development.   This  approach 
to  beginning  teacher  assessment  promotes  the  formation  of  a 
more  complete  picture  of  teaching  and  learning  in  context . 

The  results  of  the  study  could  inform  teacher  education 
program  development .   The  emergence  of  research  on  the 
differences  between  beginning  general  and  special  education 
teachers  may  be  especially  useful  to  teacher  educators  as 
they  could  revise  content  to  better  prepare  preservice 
teachers  for  their  first  year  of  teaching. 


APPENDIX  A 
PRAXIS  III  DOMAINS  AND  CRITERIA 


Domain  A   Organizing  content  knowledge  for  student  learning 
Al    Becoming  familiar  with  relevant  aspects  of 

students'  background  knowledge  and  experience 
A2    Articulating  clear  learning  goals  for  the  lesson 

that  are  appropriate  to  the  students 
A3    Demonstrating  an  understanding  of  the  connections 
between  the  content  that  was  learned  previously, 
the  current  content,  and  the  content  that  remains 
to  be  learned  in  the  future 
A4    Creating  or  selecting  teaching  methods,  learning 
activities,  and  instructional  materials  or  other 
resources  that  are  appropriate  to  the  students  and 
that  are  aligned  with  the  goals  of  the  lesson 
A5    Creating  or  selecting  evaluation  strategies  that 
are  appropriate  for  the  students  and  that  are 
aligned  with  the  goals  of  the  lesson 
Domain  B   Creating  an  environment  for  student  learning 
Bl    Creating  a  climate  that  promotes  fairness 
B2    Establishing  and  maintaining  rapport  with  students 
B3    Communicating  challenging  learning  expectations  to 
each  student 
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B4    Establishing  and  maintaining  consistent  standards 

of  classroom  behavior 
B5   Making  the  physical  environment  as  safe  and 

conducive  to  learning  as  possible 
Domain  C   Teaching  for  student  learning 

CI   Making  learning  goals  and  instructional  procedures 

clear  to  students 
C2   Making  content  comprehensible  to  students 
C3    Encouraging  students  to  extend  their  thinking 
C4    Monitoring  students'  understanding  of  content 

through  a  variety  of  means,  providing  feedback  to 

students  to  assist  learning,  and  adjusting  learning 

activities  as  the  situation  demands 
C5    Using  instructional  time  effectively 
Domain  D   Teacher  professionalism 

Dl    Reflecting  on  the  extent  to  which  the  learning 

goals  were  met 
D2    Demonstrating  a  sense  of  efficacy 
D3    Building  professional  relationships  with  colleagues 

to  share  teaching  insights  and  to  coordinate 

learning  activities  for  students 
D4    Communicating  with  parents  or  guardians  about 

student  learning 


APPENDIX  B 
QUESTIONS  FOR  ASSESSOR  REFLECTION 

Al   How  does  the  teacher  find  out  about  students'  background 

knowledge  and  experiences? 

How  does  the  teacher  find  out  about  students'  foundation 

for  understanding  of  the  content? 

Is  the  teacher  able  to  describe  why  it  is  important  to 

become  familiar  with  students'  background  knowledge  and 

experiences? 

Is  the  teacher's  degree  of  familiarity  with  students' 

background  knowledge  and  experiences  adequate  in 

relation  to  the  number  of  students  he  or  she  teaches? 
A2    Is  the  teacher  able  to  state  learning  goals  for  the 

current  lesson? 

Does  the  teacher  state  the  goals  in  terms  of  student 

outcomes,  clearly  distinguishing  outcomes  from 

activities? 

Does  the  teacher  give  a  clear  rationale  for  the  stated 

goals? 

Does  the  teacher  provide  different  goals  for  groups  or 

individual  students? 

Does  the  teacher  provide  an  acceptable  explanation  of 

why  the  differentiated  goals  are  appropriate  for  groups 

or  individual  students? 
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A3    Can  the  teacher  explain  how  the  content  he  or  she  has 
planned  for  today  connects  to  what  the  students  have 
previously  learned? 

Can  the  teacher  explain  how  the  content  he  or  she 
planned  for  today  connects  to  what  the  students  will 
study  in  the  future? 

To  what  extent  can  the  teacher  explain  how  today's 
lesson  fits  with  larger  goals  of  learning  in  the 
discipline? 

A4  Are  the  methods,  activities,  materials,  and  resources 
selected  by  the  teacher  aligned  with  the  goals  of  the 
lesson? 

Are  the  methods  and  activities  appropriate  to  the 
students'  developmental  levels?  Do  the  materials  and 
activities  provide  for  varied  styles  of  participation? 
Are  the  activities,  materials,  and  resources  appropriate 
to  the  students'  developmental  levels?   Do  they  reflect 
the  common  and  unique  experiences  of  different  ethnic 
groups,  of  males  and  females,  of  different  economic 
groups,  of  groups  with  exceptionalities?  Are  the 
activities,  and  resources  appropriate  for  students  of 
limited  English  proficiency? 

If  a  single  activity  is  used,  can  the  teacher  provide  a 
sound  explanation  of  why  a  single  activity  is 
appropriate  for  all  students/ 
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Is  there  evidence  that  the  teacher  has  considered 
various  methods,  activities,  and  materials,  and  has 
considered  the  advantages  and  disadvantages  of  each? 

A5    How  is  the  plan  for  evaluation  aligned  with  the  learning 
goals  of  the  lesson? 

Is  the  plan  for  evaluation  sufficiently  systematic  to 
provide  the  teacher  with  useful  information  about  the 
extent  to  which  learning  goals  have  been  met? 
Is  the  evaluation  appropriate  to  the  students  in  the 
class?  What  methods  are  used?  How  are  students  of 
limited  English  proficiency  and  student  with 
exceptionalities  provided  with  opportunities  to  display 
their  knowledge  of  content? 

Can  the  teacher  describe  how  he  or  she  will  use  the 
results  of  the  evaluation  in  planning  future 
instruction? 

Bl    Is  the  teacher  fair  in  interactions  with  students  during 
the  observed  class  period? 

In  what  ways  does  the  teacher  help  students  to  have 
access  to  learning? 

In  what  ways  does  the  teacher  help  the  students  feel 
equally  valued  in  the  classroom? 

Are  there  patterns  of  either  exclusion  or  overattention 
in  student-teacher  interactions? 

Does  the  teacher  show  evidence  of  stereotyped  views  of 
students? 
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Is  the  teacher  inappropriately  negative  in  remarks  to 
students? 

Do  students  treat  each  other  fairly? 

Does  the  teacher  respond  appropriately  to  stereotype- 
based,  demeaning,  or  other  unfair  comments  by  students? 

B2    Does  the  teacher  attempt  to  relate  positively  to 
students? 

Does  the  teacher  show  concern  for  the  students? 
Does  the  teacher  tailor  personal  interactions  according 
to  the  individual  characteristics  of  students? 
Do  the  teacher's  attempts  to  establish  rapport  take  into 
account  the  students'  backgrounds  and  experiences? 
Are  the  teacher's  attempts  to  establish  rapport 
appropriate  to  the  students'  developmental  levels? 

B3    How  does  the  teacher  show,  by  words,  actions,  or 

attitude,  that  each  student  is  capable  of  meaningful 

achievement? 

In  what  ways  do  the  students  demonstrate  a  clear 

understanding  of  the  teacher's  expectations  for 

achievement  that  may  have  been  stated  explicitly  prior 

to  the  observation? 

Are  the  learning  expectations  for  students  challenging 

but  within  their  reach? 

B4    Are  consistent  standards  of  classroom  behavior  evident? 
How  are  standards  established? 

Does  the  teacher  model  respectful  and  appropriate 
standards  of  behavior? 
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Do  established  standards  of  behavior  convey  a  sense  of 

respect  for  the  students? 

How  are  the  standards  maintained? 

How  does  the  teacher  respond  to  serious  behavior 

problems?  Are  her  or  his  responses  appropriate? 

Does  the  teacher  respond  to  inappropriate  behavior 

consistently  and  appropriately? 
B5    How  much  control  does  the  teacher  have  over  the  physical 

environment  ? 

Are  any  safety  violations  or  risks  evident? 

To  what  extent  is  there  a  match  between  the  lesson  or 

activity  and  the  furniture  or  room  configuration? 

Is  the  space  arranged  so  that  all  students,  including 

those  with  special  needs,  have  access  to  the  lesson? 

How  does  the  room  reflect  the  learning  that  takes  place 

there? 
CI    Does  the  teacher  communicate  learning  goals  to  the 

students,  either  explicitly  or  implicitly? 

Are  the  directions  to  students  for  instructional 

procedures  clear? 

How  does  the  teacher  help  students  of  different 

backgrounds  (ethnic  groups,  language  groups,  males  and 

females,  students  with  exceptionalities)  understand  the 

learning  goals  of  the  lesson? 

How  does  the  teacher  help  students  of  different 

backgrounds  (ethnic  groups,  language  groups,  males  and 
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females,  students  with  exceptionalities)  understand  the 

instructional  procedures  of  the  lesson? 

Are  the  students  able  to  carry  out  the  instructional 

procedures? 
C2    Does  the  teacher  communicate  content  clearly  and 

accurately?   Is  this  done  equitably  for  females  and 

males,  students  of  different  ethnic  groups,  students  of 

different  economic  groups,  students  with 

exceptionalities,  students  of  limited  English 

proficiency? 

In  lessons  that  are  not  teacher-directed,  has  the 

teacher  structured  the  learning  environment  or  process 

in  a  way  that  enables  students  to  understand  the 

content? 

Are  students  generally  engaged  with  the  content? 

Does  the  lesson  as  a  whole  have  a  coherent  structure? 
C3    Does  the  teacher  recognize  and  use  opportunities  to  help 

students  extend  their  thinking? 

Is  the  teacher  able  to  use  the  current  content 

appropriately  as  a  springboard  to  independent,  creative, 

or  critical  thinking? 

Does  the  teacher  challenge  students'  thinking  in  ways 

relevant  to  their  background  knowledge  and  experiences? 

Does  the  teacher  structure  specific  learning  activities 

that  encourage  students  to  extend  their  thinking? 
C4    Does  the  teacher  monitor  students'  understanding  of  the 

content?   Is  this  don  equitably? 


97 

Does  the  teacher  provide  substantive  feedback  to 

students?   Is  this  done  equitably? 

Does  the  teacher  adjust  learning  activities  as  needed? 

Is  the  adjustment  equitable? 
C5    Is  the  instruction  paced  in  such  a  way  that  students 

appear  to  be  on  task  most  of  the  time? 

Is  there  evidence  of  established  routines  and  procedures 

that  help  the  teacher  maximize  the  time  available  for 

instruction? 

If  a  noninstructional  interruption  occurs,  is 

instruction  resumed  efficiently? 

Do  all  students  have  meaningful  work  or  activities  for 

the  entire  instructional  time? 
Dl    What  judgments  does  the  teacher  make  about  the  extent  to 

which  the  goals  were  met?   Are  these  judgments  accurate? 

How  does  the  teacher  support  her  or  his  judgment? 

What  explanation  does  the  teacher  give  for  deviations 

from  the  instructional  plan? 

How  does  the  teacher  analyze  the  effectiveness  of  her  or 

his  teaching  strategies? 

How  does  the  teacher  articulate  ways  in  which  insights 

gained  from  this  lesson  could  be  used  to  improve  future 

instruction? 
D2    In  what  ways  does  the  teacher  convey  a  sense  of  efficacy 

with  respect  to  students'  learning? 
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What  specific  actions  does  the  teacher  suggest  for 
working  with  individual  students  who  are  not  meeting  the 
learning  goals? 

D3    Does  the  teacher  identify  colleagues  within  the  school 
who  can  provide  instructional  help  that  is  relevant  to 
the  observed  lesson  or  to  students  in  the  class? 
If  appropriate,  does  the  teacher  identify  colleagues 
whose  participation  is  either  necessary  or  helpful  in 
coordinating  learning  activities  for  students? 
Does  the  teacher  consult  with  colleagues  on  matters 
related  to  learning  and  instruction  or  other 
professional  matters? 

In  what  ways  does  the  teacher  collaborate  with 
colleagues  outside  his  or  her  classroom  to  coordinate 
learning  activities  or  address  other  teaching  concerns? 

D4    Does  the  teacher  demonstrate  knowledge  of  how  he  or  she 
could  communicate  with  parents  or  guardians? 
Does  the  teacher  communicate  appropriately  with  paretns 
or  guardians  in  ways  that  are  suitable  for  his  or  her 
teaching  situations? 


APPENDIX  C 
CANDIDATE  PROFILE 


The  following  are  questions  to  be  completed  by  the 
participant  of  the  study. 
1.    What  is  your  age? 


a. 
b. 

Under 
25-34 

25 

c. 

35-44 

d. 

45-54 

e. 

55-64 

f . 

65  or 

over 

2.  What  is  your  gender? 

a .  Female 

b.  Male 

3.  How  do  you  describe  yourself? 

a.  African  American  or  Black 

b.  Asian  American/Asian  (Ex. :   Japanese,  Chinese, 
Korean) 

c.  Southeast  Asian  American/Southeast  Asian  (Ex.: 
Cambodian,  Hmong,  Khmer,  Laotian,  Vietnamese) 

d.  Pacific  Island  American/Pacific  Islander 

e.  Mexican,  Mexican  American,  or  Chicano 

f.  Puerto  Rican 

g.  Other  Hispanic,  Latino,  or  Latin  American 

h.    Native  American,  American  Indian,  or  Alaskan  Native 

i.    White 

j.    Other  (please  specify)  

Questions  4-7 

Please  provide  the  following  information  regarding  your 

ACADEMIC  BACKGROUND  (Check  and  complete  ALL  that  apply) . 

4.  Bachelor's  degree 

a .  Not  begun 

b.  In  progress 

c.  Completed 


99 


100 


Major  (please  specify) 
Minor  (please  specify) 


Master's  degree  or  equivalent 

a.  Not  begun 

b.  In  progress 

c.  Completed 

Major  (please  specify)  


Doctorate  or  equivalent 

a .  Not  begun 

b.  In  progress 

c .  Completed 

Are  you  going  through  an  alternate-route  teacher 
training  program? 

a.  Yes 

b.  No 

Which  of  the  following  best  describes  the  type  of 
SCHOOL  in  which  you  are  CURRENTLY  teaching? 

a.  Primary  elementary 

b.  Upper  elementary 

c.  Comprehensive  elementary 

d.  Middle 

e.  Junior  high 

f.  Senior  high 

g.  Comprehensive  secondary 

h.    Other  (please  specify)  


Which  of  the  following  best  describes  the  LEVEL  of  your 
primary  teaching  assignment? 

a.  Pre-Kindergarten  -  Grade  2 

b.  Grades  3-5 

c.  Grades  6-8 

d.  Grades  9-12 

e.  More  than  one  of  the  levels  above 

(please  specify)  


10.   Which  of  the  following  best  describes  the  CONTENT  of 
your  primary  teaching  assignment? 

a.  All  or  most  elementary  school  subjects 

b.  All  or  most  middle  school  subjects 

c.  Business 

d.  Computer  science 
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English  as  a  second  language 

Foreign  language 

Health/physical  education 

Home  economics 

Language  arts/communications 

Mathematics 

Physical /biological /chemical  sciences 

Social  sciences 

Special  education 

Visual  arts/music/theatre/dance 

Vocational  education 

Other  (please  specify)  


11. 


Which  of  the  following  best  describes  your  CURRENT 
STATUS? 


a.  Temporary  substitute  teacher  (assigned  on  a  daily 
basis) 

b.  Permanent  substitute  teacher  (assigned  on  a  long- 
term  basis) 

c.  Teacher  with  emergency /temporary  license 

d.  Student  teacher 

e.  First-year  teacher 

f.  Teacher  with  one  or  more  years  of  experience 

g.  Other  (please  specify)  


APPENDIX  D 
LETTER  TO  BEGINNING  TEACHERS 


January  25,  1994 


firstname  lastname 

school 

address 

city,  state   zip  code 

Dear  salute, 

As  we  begin  the  new  year,  we  hope  that  your  school  year 
thus  far  has  been  a  successful  one.   We  are  writing  to  ask 
for  your  participation  in  an  important  and  interesting 
research  endeavor.   Project  SEART-C,  at  the  University  of 
Florida,  is  an  investigation  of  teacher  education  programs  in 
Florida.   In  the  current  phase  of  the  project,  SEART-C  staff 
members  are  ready  to  begin  observations  of  participants  in 
traditional  programs.   The  (name  of  university)  Teacher 
Preparation  Program  is  one  of  the  programs  under 
consideration.   We  would  like  to  observe  as  many  of  the 
participants  in  this  program  as  possible. 

We  would  like  to  encourage  you  to  volunteer  for  this 
project  because: 

1)  It  will  help  provide  valuable  information  regarding 
the  effectiveness  of  this  teacher  preparation  program,  and 

2 )  It  will  provide  valuable  feedback  to  you  personally 
about  your  teaching  through  a  process  that  allows  for 
interaction  between  the  teacher  and  the  observer. 

The  information  obtained  through  the  observations  will 
remain  strictly  confidential  and  therefore  will  not  be  shared 
with  principals,  district  personnel,  or  any  (name  of 
university)  Teacher  Preparation  Program  faculty.   All  data 
collected  for  Project  SEART-C  are  aggregated  and  reported 
only  in  term  of  categories  of  teacher  education  programs. 
However,  the  SEART-C  staff  member  that  conducts  the 
observation  will  be  happy  to  provide  individualized  feedback 
for  your  own  information.   This  experience  and  the 
information  you  gain  may  be  a  valuable  asset  for  you  as  you 
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complete  your  portfolio  for  the  Professional  Orientation 
Program.   The  experience  is  intended  to  be  a  mutually 
beneficial  one  and  not  stressful  for  you  in  any  way. 

Your  participation  would  most  likely  require  a  total  of 
1  1/2  hours.   That  time  would  include  (a)  completing  2  forms 
about  your  class  and  the  lesson  and  (b)  participating  in  2 
brief  interviews,  pre  and  post  observation.   If  you  agree  to 
participate,  you  will  be  fully  informed  as  to  the  exact 
nature  of  the  observation  process.   You  will  be  give  a  chance 
to  examine  all  materials  the  observer  uses  before  the 
observation  process  begins. 

Please  check  the  appropriate  box  on  the  enclosed  self- 
addressed  postcard  and  return  it  to  us.   If  you  agree  to 
participate,  we  will  contact  you  to  set  up  a  convenient 
observation  date.   We  appreciate  your  careful  consideration 
of  this  opportunity  both  to  contribute  to  important  research 
and  to  participate  in  lifelong  learning.   If  you  have  nay 
questions  regarding  the  research  or  your  participation,  feel 
free  to  call  Mary  Eisele  or  Ann  Daunic  at  the  University  of 
Florida  (904/392-0701,  extension  279)  at  any  time.   We  wish 
you  the  best  in  the  remainder  of  the  1994-95  school  year. 

Warmest  regards , 


Mary  R.  Eisele 
Evaluation  Specialist 
Project  SEART-C 


Ann  P.  Daunic 
Evaluation  Specialist 
Project  SEART-C 


APPENDIX  E 
PARTICIPANT  INFORMED  CONSENT 


My  name  is  Paul  Sindelar,  the  principal  investigator  of 
Project  SEART-C.   We  are  conducting  an  evaluation  of  teacher 
training  programs  in  Florida.   The  purpose  of  this  evaluation 
is  to  assess  programs  that  offer  certification  in  education. 
We  plan  to  talk  with  program  administrators,  training 
personnel  or  faculty,  as  well  as  program  participants.   The 
evaluation  has  three  components:   interviews,  profiles,  and 
observations . 

As  a  program  participant,  we  ask  that  you  engage  in 
several  layers  of  assessment.   First,  complete  two  profiles. 
Second,  permit  us  to  observe  you  while  you  teach.   Third 
participate  in  preobservation  and  postobservation  interviews 
with  an  Evaluation  Specialist  from  our  project. 

There  are  no  known  risks  or  discomforts  to  be  expected 
as  a  result  of  participating  in  this  study.  There  are  also 
no  direct  benefits  to  you  as  the  participant. 

Profiles  typically  take  about  one  hour  to  answer,  and 
interviews  may  take  from  20  to  30  minutes  each.   We  estimate 
that  the  observed  lesson  will  take  from  20  to  50  minutes  to 
complete.   On  profiles  and  interviews,  you  may  choose  not  to 
answer  any  question  which  you  do  not  wish  to  answer.   Your 
participation  is  voluntary,  and  you  can  withdraw  from  any 
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part  of  this  study  at  any  time  without  penalty. 
Unfortunately,  I  cannot  offer  you  any  compensation  for 
participation. 

Profiles,  interviews,  and  observations  will  be  coded  for 
the  purpose  of  follow-up  contact  when  necessary.   Only 
project  staff  and  consultants  will  view  these  data.   All  data 
will  be  numerically  coded  with  no  identifiable  reference  to 
you  and  will  be  kept  confidential.   Data  will  be  destroyed 
after  analysis,  and  all  results  will  be  reported  in  an 
aggregate  or  group  form. 

If  in  the  future  you  should  have  any  questions  about 
this  procedure  you  may  contact  me  at  (904)  392-0701  ext .  279. 

PROJECT  SEART-C   INFORMED  CONSENT  FORM 
FOR   PROGRAM   PARTICIPANTS 

I  have  read  and  understand  the  procedure  described 
above.   I  agree  to  participate  in  the  procedure  and  I  have 
received  a  copy  of  this  description. 


Signature  Date 


APPENDIX  F 
RECORD  OF  EVIDENCE 


The  following  is  an  example  of  one  section  from  the  record  of 
evidence  form  that  is  completed  by  the  assessor. 

A.    Becoming  familiar  with  relevant  aspects  of  students' 

background  knowledge  and  experiences, 
(assessor  provides  written  examples  of  positive  and  negative 
evidence) 

Summary  Statement : 

(assessor  writes  a  statement  that  is  aligned  with  the  scoring 

rules  and  matrices) 

Evaluation: 

1.0   1.5   2.0   2.5   3.0   3.5 
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APPENDIX  G 
PRAXIS  III  SCORING  RULES  AND  MATRICES 

Becoming  familiar  with  relevant  aspects  of  students' 
background  knowledge  and  experiences 


Scoring  Rules 


1.0   The  teacher  demonstrates  a  lack  of  understanding  of 
why  it  is  important  to  become  familiar  with 
students'  background  experiences,  does  not  know  how 
to  find  this  information,  and  lacks  familiarity 
with  students '  background  experiences . 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  demonstrates  some  understanding  of  why 
it  is  important  to  become  familiar  with  students' 
background  experiences,  describes  one  procedure 
used  to  obtain  this  information,  and  has  some 
familiarity  with  the  background  and  experiences  of 
students  in  the  class. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  demonstrates  a  comprehensive 

understanding  of  why  it  is  important  to  become 
familiar  with  students'  background  experiences, 
describes  several  procedures  used  to  obtain  this 
information,  and  demonstrates  a  clear  understanding 
of  students'  background  knowledge  and  experiences. 

3 . 5   Above  level  3 . 0 


Understanding  of 

Knowledge  of  how 

Level  of 

importance  of 

to  become 

understanding  of 

becoming 

familiar 

students' 

familiar 

background 
experiences 

1.0 

Lacks 

Doesn't  know  how 

Lacks 

understanding 

familiarity 

2.0 

Some 

Describes  one 

Some  familiarity 

understanding 

procedure  used 

3.0 

Comprehensive 

Describes 

Clear 

understanding 

several 
procedures  used 

under s  t  anding 
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A2 


Articulating  clear  learning  goals  for  the  lesson  that 
are  appropriate  to  the  students 


Scoring  Rules 


1.0  The  teacher  does  not  articulate  clear  learning 
goals  OR  the  teacher  has  chosen  goals  that  are 
inappropriate  for  the  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  articulates  clear  learning  goals  that 
are  appropriate  for  the  students. 

2.5   Above  level  2.0,  but  below  level  3.0 

3  . 0   The  teacher  articulates  clear  learning  goals  and 

provides  a  well-thought-out  explanation  of  why  they 
are  appropriate  for  the  students  OR  the  teacher 
articulates  clear  learning  goals  that  are 
appropriate  to  the  students  and  are  differentiated 
for  groups  or  individual  students  in  the  class. 

3  .  5   Above  level  3 . 0 


Clear  articulation  of 
goals 

Appropriateness  for 
students 

1.0 

Not  Clear                OR    Inappropriate 

2.0 

Clear 

Appropriate  in  general 

3.0 

Clear 

Explanation  of  why 
appropriate  for  all 
students  OR 
differentiated  goals 

109 


A3    Demonstrating  an  understanding  of  the  connections 

between  the  content  that  was  learned  previously,  the 
current  content,  and  the  content  that  remains  to  be 
learned  in  the  future 

Scoring  Rules 

1 . 0   The  teacher  does  not  explain  how  the  content  of 

this  lesson  relates  to  the  content  of  previous  or 
future  lessons  OR  the  explanation  given  is 
illogical  or  inaccurate. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  accurately  explains  how  the  content  of 
this  lesson  relates  to  the  content  of  previous  or 
future  lessons . 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  accurately  explains  how  the  content  of  this 
lesson  fits  within  the  structure  of  the  discipline. 

3  .  5   Above  level  3  .  0 


Explanation  of  relation 
to  previous  and  future 
lessons 

Fit  within  structure  of 
discipline 

1.0 

Doesn't  explain  OR 
explanation  is  illogical 

N/A 

2.0 

Explains  previous  or 
future  accurately 

N/A 

3.0 

Explains  previous  or 
future  accurately 

Explains  accurately 
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A4    Creating  or  selecting  teaching  methods,  learning 
activities,  and  instructional  materials  or  other 
resources  that  are  appropriate  to  the  students  and  that 
are  aligned  with  the  goals  of  the  lesson 

Scoring  Rules 

1.0   The  teacher  chooses  methods,  activities,  or 

materials  that  are  unrelated  to  the  goals  of  the 
lesson  OR  the  methods,  activities,  or  materials  are 
clearly  not  appropriate  to  the  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  chooses  methods,  activities,  and 

materials  that  are  aligned  with  the  goals  of  the 
lesson  and  that  are  appropriate  to  the  students  in 
general . 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  chooses  methods,  activities,  and  materials 
that  allow  a  differentiated  learning  experience  for 
individuals  or  groups  of  students  OR  the  teacher 
provides  a  sound  explanation  of  why  the  single 
teaching  method  or  learning  activity  in  the  lesson 
is  appropriate  for  all  students. 

3 . 5   Above  level  3 . 0 


Alignment  with  goals 

Appropriateness  for 
students 

1.0 

Unrelated                OR    Inappropriate 

2.0 

Aligned  with  goals 

Appropriate  to  students 
in  qeneral 

3.0 

Aligned  with  goals 

Allow  for  differentiated 
learning  experiences  OR 
sound  explanation  of  why 
single  method  or 
activity  is  appropriate 

Ill 


A5    Creating  or  selecting  evaluation  strategies  that  are 

appropriate  for  the  students  and  that  are  aligned  with 
the  goals  of  the  lesson 

Scoring  Rules 

1.0   The  teacher  has  not  provided  for  systematically 
evaluating  student  learning  OR  the  evaluation 
planned  is  clearly  inappropriate  either  to  the 
goals  of  the  lesson  or  to  the  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  has  a  plan  for  systematically 

evaluating  student  learning  that  is  aligned  with 
the  goals  of  the  lesson  and  appropriate  to  the 
students . 

2  .  5   Above  level  2.0,  but  below  level  3 . 0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  can  describe  how  he  or  she  will  use  the 
results  of  the  evaluation  in  planning  future 
instruction. 

3 . 5   Above  level  3 . 0 


Plan  for 

systematic 

evaluation 

Appropriateness 
for  goals  and 

students 

Use  of  results 
for  planning 

1.0 

Not  provided 

OR 

inappropriate 
for  goals  or 
students 

N/A 

2.0 

Provided  and 
systematic 

Appropriate  for 
goals  and 
students 

N/A 

3.0 

Provided  and 
systematic 

Appropriate  for 
goals  and 
students 

Describes  how 
will  use 
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Bl    Creating  a  climate  that  promotes  fairness 

Scoring  Rules 

1.0  The  teacher  is  unfair  in  the  treatment  of  students 
OR  the  teacher  tolerates  obviously  unfair  behavior 
among  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  is  fair  in  the  treatment  of  students 

and  does  not  accept  obviously  unfair  behavior  among 
students. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  is  fair  in  the  treatment  of  students 
and  actively  encourages  fairness  among  students. 

3  .  5   Above  level  3 . 0 


Teacher  treatment  of 
students 

Teacher  handling  of 
fairness  among  students 

1.0 

Unfair  to  students        OR    tolerates 

obviously  unfair 
behavior  among  students 

2.0 

Fair  to  students 

Does  not  accept 
obviously  unfair 
behavior  among  students 

3.0 

Fair  to  students 

Actively  encourages 
fairness  among  students 
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B2    Establishing  and  maintaining  rapport  with  students 

Scoring  Rules 

1.0   The  teacher  does  not  attempt  to  establish  rapport 
with  students  OR  the  teacher's  attempts  are 
inappropriate . 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  establishes  a  basic  level  of  rapport 
with  the  students. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  successfully  establishes  rapport  in 
ways  that  are  appropriate  to  students '  diverse 
backgrounds  and  needs . 

3  .  5   Above  level  3 . 0 


Establishment  of  rapport 

Appropriateness  to 
students 

1.0 

No  attempt  is  made       OR    attempts  made  are 

inappropriate 

2.0 

Basic  level  of  rapport 
is  established 

Generally  appropriate, 
not  diversified 

3.0 

Attempts  to  establish 
rapport  are  successful 

Appropriate  to  students' 
diverse  needs  and 
backgrounds 
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B3 


Communicating  challenging  learning  expectations  to  each 
student 


Scoring  Rules 


1.0   The  teacher  communicates  explicitly  or  implicitly 
to  individuals,  to  groups  within  the  class,  or  to 
the  class  as  a  whole  that  they  are  incapable  of 
learning  or  that  the  teacher's  expectations  for 
their  learning  are  very  low. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0  The  teacher  does  nothing  to  communicate  to  any 
student  that  he  or  she  is  incapable  of  meeting 
learning  expectations. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  actively  encourages  students  to  meet 
challenging  learning  expectations. 

3  .  5   Above  level  3 . 0 


Explicit  or  implicit  communication  to  class, 
groups,  or  any  individual  about  learning 
expectations 

1.0 

Communicates  low  expectations 

2.0 

Neutral;  no  negative  effects 

3.0 

Actively  encourages  students  to  meet  challenging 
expectations 
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B4 


Establishing  and  maintaining  consistent  standards  of 
classroom  behavior 


Scoring  Rules 


1 . 0   The  teacher  makes  no  attempt  to  respond  to 

disruptive  behavior  OR  the  teacher's  response  to 
disruptive  behavior  does  not  demonstrate  respect 
for  the  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  makes  appropriate  attempts  to  respond 
to  disruptive  behavior  in  ways  that  demonstrate 
respect  for  the  students  OR  there  is  no  disruptive 
behavior  during  the  lesson. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  responds  to  minor  misbehavior  consistently 
and  with  reasonable  success,  in  ways  that 
demonstrate  respect  for  students  OR  student 
behavior  during  the  lesson  is  consistently 
appropriate. 

3  .  5   Above  level  3 . 0 


Response  to  behavior     I  Respect  for  students 

1.0 

No  attempt  to  respond  to  OR    response  doesn't 
disruptive  behavior       demonstrate  respect 

2.0 

Appropriate  attempts  to 
respond  to  disruptive 
behavior  OR  no 
disruptive  behavior 

Attempts  to  respond 
demonstrate  respect 

3.0 

Consistent,  reasonably 
successful  responses  to 
disruptive  behavior  and 
minor  misbehavior  OR 
student  behavior 
consistently  appropriate 

Responses  demonstrate 
respect 
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B5    Making  the  physical  environment  as  safe  and  conducive  to 
learning  as  possible 

Scoring  Rules 

1.0   The  teacher  allows  the  physical  environment  to  be 
unsafe  OR  the  teacher  allows  the  physical 
environment  to  interfere  with  learning. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  creates  a  physical  environment  that  is 
safe  and  does  not  interfere  with  learning. 

2.5   Above  level  2.0,  but  below  level  3.0 

3 . 0   The  teacher  uses  the  physical  environment  as  a 

resource  to  facilitate  learning.   Provisions  are 
made  to  accommodate  all  students,  including  those 
with  special  needs.   If  the  teacher  does  not 
control  the  physical  environment,  he  or  she 
effectively  adjusts  the  activities  to  the  existing 
physical  environment . 

3  .  5   Above  level  3 . 0 


Safety 

Conduciveness  to 
learning 

1.0 

Allows  unsafe  conditions  OR    allows  to 

interfere  with  learning 

2.0 

Safe 

Doesn't  interfere  with 
learning 

3.0 

Safe 

Used  as  a  resource  and 
all  students'  needs 
accommodated 

OR 
Cannot  control  conditions  but  effectively  adjusts 
activities  for  environment 

117 


CI 


Making  learning  goals  and  instructional  procedures  clear 
to  students 


Scoring  Rules 


1.0   The  teacher  provides  the  students  with  no 

information,  confusing  information,  or  inaccurate 
information  about  the  learning  goals  or  the 
instructional  procedures  for  the  lesson. 

1 . 5   Above  level  1.0,  but  below  level  2 . 0 

2 . 0   The  students  receive  accurate  information  about  the 
learning  goals.   The  teacher  provides  the  students 
with  clear,  accurate  information  about  the 
instructional  procedures  for  the  lesson,  and  most 
of  the  students  seem  to  understand. 


2.5   Above  level  2.0,  but  below  level  3.0 

3.0  In  addition  to  the  requirements  for  level  2.0, 
students  seem  to  understand  the  learning  goals 
fully.  The  teacher  ensures  that  all  students, 
including  those  who  may  initially  have  trouble, 
understand  and  can  carry  out  the  instructional 
procedures  for  the  lesson. 

3  .  5   Above  level  3 . 0 


the 


Learninq  qoals          |  Instructional  procedures 

1.0 

Students  receive  no       OR    students  receive 
information,  confusing    no  information, 
information,  or          confusing  information, 
inaccurate  information    or  inaccurate 
about  goals              information  about 

instructional  procedures 

2.0 

Students  receive 
accurate  information 

Teacher  provides  clean, 
accurate  information; 
most  students  seem  to 
understand 

3.0 

Students  receive 
accurate  information  and 
seem  to  understand  fully 

All  students,  including 
those  who  have  trouble 
initially,  can  carry  out 
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C2    Making  content  comprehensible  to  students 

Scoring  Rules 

1 . 0   The  content  appears  to  be  incomprehensible  to  the 
students  OR  the  lesson  contains  substantive 
inaccuracies. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  content  is  accurate  and  appears  to  be 
comprehensible  to  the  students . 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
lesson  as  a  whole  has  a  logical  and  coherent 
structure. 

3  .  5   Above  level  3 . 0 


Accuracy  of 
content 

Comprehensibil- 
ity  of  content 

Lesson  structure 

1.0 

Inaccurate        OR    appears     N/A 
incomprehensible 

2.0 

Accurate 

Appears 
comprehensible 

N/A 

3.0 

Accurate 

Appears 
comprehensible 

Logical  and 
coherent 
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C3    Encouraging  students  to  extend  their  thinking 

Scoring  Rules 

1 . 0   The  teacher  discourages  students  from  thinking 
independently,  creatively,  or  critically. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  encourages  students  to  think 

independently,  creatively,  or  critically  in  the 
context  of  the  content  being  studied. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  uses  activities  or  strategies  that  are 
specifically  designed  to  actively  encourage 
students  to  think  independently,  creatively,  or 
critically  about  the  content  being  taught . 

3  .  5   Above  level  3  .  0 


Encouragement  of  independent,  creative,  or 
critical  thinking 

1.0 

Discourages 

2.0 

Encourages  within  existing  context  of  lesson 

3.0 

Encourages  through  activities  or  strategies 
designed  or  chosen  with  this  intent 
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C4   Monitoring  students'  understanding  of  content  through  a 
variety  of  means,  providing  feedback  to  students  to 
assist  learning,  and  adjusting  learning  activities  as 
the  situation  demands 


Scoring  Rules 


1 . 0   The  teacher  makes  no  attempt  to  determine  whether 
students  are  understanding  and  gives  them  no 
feedback . 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  monitors  the  students'  understanding  of 
the  content.   The  students  receive  feedback  as 
necessary. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  monitors  individual  students'  or  groups 
of  students'  understanding  of  the  content  and  makes 
appropriate  instructional  adjustments  if  necessary. 
If  appropriate,  students  receive  substantive  and 
specific  feedback. 

3  .  5   Above  level  3 . 0 


Monitoring 

Providing 
feedback 

Adjusting 

1.0 

No  attempt 

Not  provided 

N/A 

2.0 

Monitors 
understanding 

Provides  as 
necessary 

N/A 

3.0 

Monitors 
individuals'  or 
groups ' 
understanding 

Provides  as 
necessary; 
substantive  and 
specific 

Adjusts  as 
necessary 
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C5    Using  instructional  time  effectively 

Scoring  Rules 

1.0   Substantial  amounts  of  instructional  time  are  spent 
on  activities  of  little  instructional  value  OR  the 
pacing  of  the  lesson  is  inappropriate  to  the 
content  and/or  the  students. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  pacing  of  the  lesson  is  appropriate  for  most  of 
the  students.   Noninstructional  procedural  matters 
do  not  occupy  an  excessive  amount  of  time. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  provides  students  with  activities  of 
instructional  value  for  the  entire  instructional 
time  and  paces  them  appropriately.   Any  necessary 
noninstructional  procedures  are  performed 
efficiently. 

3  .  5   Above  level  3 . 0 


Use  of  instructional 

Pacing 

time 

1.0 

Substantial  time  on 

OR    pacing 

activities  of  little 

inappropriate 

instructional  value 

2.0 

Time  on  noninstructional 

Pacing  appropriate  for 

activities  not  excessive 

most  students 

3.0 

Entire  instructional 
time  on  activities  of 
instructional  value; 
noninstructional 
procedures  efficient 

Pacing  appropriate 

122 


Dl    Reflecting  on  the  extent  to  which  the  learning  goals 
were  met 

Scoring  Rules 

1.0   The  teacher  cannot  accurately  identify  strengths 
and  weaknesses  of  the  lesson  in  relation  to  the 
learning  goals . 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  accurately  describes  the  strengths  and 
weaknesses  of  the  lesson  in  relation  to  the 
learning  goals  and  describes  in  general  terms  how 
he  or  she  could  use  the  experience  from  this  lesson 
in  future  instruction. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  supports  his  or  her  judgments  with  specific 
evidence  from  the  observed  lesson. 

3  .  5   Above  level  3 . 0 


Identifying  strengths 
and  weaknesses  of  lesson 

Using  this  experience  in 
future 

1.0 

Cannot  identify  in       N/A 
relation  to  lesson  goals 

2.0 

Describes  accurately  in 
relation  to  lesson  goals 

Describes  in  general 
terms  how  can  use  this 
experience  in  future 
instruction 

3.0 

Describes  accurately  in 
relation  to  lesson  goals 

Describes  how  can  use 
this  experience  in 
future  instruction 

Uses  specific  evidence  to  support  "judgments 
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D2    Demonstrating  a  sense  of  efficacy 

Scoring  Rules 

1.0   The  teacher  makes  no  attempt  to  find  ways  to  help 
students  who  are  not  meeting  the  learning  goals. 

1.5   Above  level  1.0,  but  below  level  2.0 

2.0   The  teacher  attempts  to  find  ways  to  help  specific 
students  who  are  not  meeting  the  learning  goals, 
but  cannot  suggest  any  specific,  practical  actions 
that  he  or  she  has  not  already  tried. 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   The  teacher  suggests  specific,  practical  actions 
that  he  or  she  intends  to  take  to  help  specific 
students  who  are  not  meeting  the  learning  goals. 

3  .  5   Above  level  3 . 0 


Attempts  to  help  students  who  are  not  meeting 
learning  goals 

1.0 

No  attempt 

2.0 

Attempts  to  help,  but  can't  suggest  specific, 
practical  actions  beyond  those  already  tried 

3.0 

Attempts  to  help  and  suggests  specific,  practical 
actions  that  intends  to  try  with  specific  students 
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D3    Building  professional  relationships  with  colleagues  to 
share  teaching  insights  and  to  coordinate  learning 
activities  for  students 

Scoring  Rules 

1.0   The  teacher  demonstrates  no  knowledge  of  resources 
available  through  colleagues  in  the  school  or 
district  OR  the  teacher  is  aware  of  such  resources, 
but  does  not  attempt  to  use  them,  despite  an 
obvious  need. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  demonstrates  knowledge  of  resources  and 
attempts  to  consult  with  colleagues  when  necessary 
on  matters  related  to  learning  and  instruction. 

2 . 5   Above  level  2.0,  but  below  level  3 . 0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  collaborates  with  colleagues  outside  of  his 
or  her  own  classroom  to  coordinate  learning 
activities  or  to  address  other  concerns  related  to 
teaching. 

3  .  5   Above  level  3 . 0 


Knowledge  of  resources 

Professional 
interactions  related  to 
learning  and  instruction 

1.0 

No  knowledge  OR  aware 
but  ignores  them, 
despite  need 

N/A 

2.0 

Demonstrates  knowledge 

Attempts  to  consult  when 
necessary 

3.0 

Demonstrates  knowledge 

Collaborates  to 
coordinate  learning 
activities  or  address 
other  teaching  concerns 
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D4    Communicating  with  parents  or  guardians  about  student 
learning 

Scoring  Rules 

1 . 0   The  teacher  demonstrates  no  knowledge  of  forms  of 

communication  that  she  or  he  can  use  to  communicate 
with  parents  or  guardians  OR  the  teacher  makes  no 
attempt  to  communicate  with  parents  or  guardians, 
even  when  it  is  clearly  necessary  to  do  so. 

1.5   Above  level  1.0,  but  below  level  2.0 

2 . 0   The  teacher  demonstrates  knowledge  of  forms  of 

communication  that  she  or  he  can  use  to  communicate 
with  parents  or  guardians  of  students  for  various 
purposes . 

2.5   Above  level  2.0,  but  below  level  3.0 

3.0   In  addition  to  the  requirements  for  level  2.0,  the 
teacher  describes  situations  in  which  she  or  he  has 
communicated  or  would  communicate  with  parents  or 
guardians  regarding  specific  students  and  indicates 
the  forms  of  communication  she  or  he  has  used  or 
would  use. 

3  .  5   Above  level  3 . 0 


Knowledge  of  forms  of 
communication  with 
parents  or  guardians 

Attempts  to  communicate 
(actual  or  hypothetical) 

1.0 

No  knowledge             OR    no  attempt,  even 

if  clearly  necessary 

2.0 

Demonstrates  knowledge 

Links  forms  to  various 
purposes 

3.0 

Demonstrates  knowledge 

With  reference  to 
specific  students, 
describes  situations 
that  call  for 
communication  and 
relevant  forms  of 
communication 

APPENDIX  H 
CLASS  PROFILE 


The  following  are  questions  to  be  completed  by  the 
participant  of  the  study. 


1.    Which  of  the  following  best  describes  the  LEVEL  of  the 
class  being  observed? 

a.  Pre-Kindergarten  -  Grade  2 

b.  Grades  3-5 

c.  Grades  6-8 

d.  Grades  9-12 

e.  More  than  one  of  the  levels  above 

(please  specify)  


2.    Which  of  the  following  best  describes  the  CONTENT  of 

the  class  being  observed? 

a.  Business 

b.  Computer  science 

c.  English  as  a  second  language 

d.  Foreign  language 

e.  Health/physical  education 

f .  Home  economics 

g.  Language  arts /communications 
h.  Mathematics 

i.  Physical/biological/chemical  sciences 

j .  Social  sciences 

k.  Special  education 

1.  Visual  arts/music/theatre/dance 

m.  Vocational  education 

n.  Other  (please  specify)  


Which  of  the  following  best  describes  the  areas  from 
which  your  students  come?   (Check  ALL  that  apply.) 

a.  Low  income,  urban 

b.  Middle  or  upper  income,  urban 

c.  Low  income,  suburban 

d.  Middle  or  upper  income,  suburban 

e.  Low  income,  small  town  (not  suburban) 

f.  Middle  or  upper  income,  small  town  (not  suburban) 
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g.    Low  income,  rural 

h.    Middle  or  upper  income,  rural 

4.    What  is  the  TOTAL  NUMBER  of  students  enrolled  in  the 
class  to  be  observed? 

5a.   What  is  the  number  of  MALE  students? 

5b.   What  is  the  number  of  FEMALE  students? 

6.  What  is  the  AGE  range  for  all  of  the  students  in  the 
class? 

7.  What  is  the  estimated  number  of  students  identified  in 
each  RACIAL/ETHNIC  GROUP? 

a.  African  American  or  Black 

b.  Asian  American/Asian  (Ex. :   Japanese,  Chinese, 
Korean) 

c.  Southeast  Asian  American/Southeast  Asian  (Ex.: 
Cambodian,  Hmong,  Khmer,  Laotian,  Vietnamese) 

d.  Pacific  Island  American/Pacific  Islander 

e.  Mexican,  Mexican  American,  or  Chicano 

f.  Puerto  Rican 

g.  Other  Hispanic,  Latino,  or  Latin  American 

h.    Native  American,  American  Indian,  or  Alaskan  Native 

i.    White 

j  .    Other  (please  specify)  

8 .  What  is  the  estimated  number  of  students  in  each  of  the 
following  LANGUAGE  categories? 

a.  English  language  proficient 

b.  Limited  English  language  proficient 

9.  Approximately  what  PERCENTAGE  of  your  class  can  be 
categorized  as  the  following? 

a.  Above-average  or  advanced  skill  level 

b.  Average  or  intermediate  skill  level 

c.  Below-average  skill  level 

10.  Approximately  how  many  students  in  this  class  have  been 
identified  as  having  EXCEPTIONALITIES? 

a.  Blind  or  visually  impaired 

b.  Deaf  or  hearing  impaired 

c.  Developmentally  disabled 

d.  Emotionally  or  behaviorally  disabled 

e.  Gifted 

f.  Learning  disabled 

g.  Physically  disabled 

h.    Other  (please  specify)  
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11.  Is  there  anything  about  the  LEARNING  ENVIRONMENT  that 
you  think  might  affect  your  students  or  the  scheduled 
observation  (e.g.,  this  is  not  your  own  classroom;  there 
is  a  new  display,  pet,  or  equipment  in  the  room;  there 
is  construction  going  on  in  the  building) ?   Is  so, 
please  note. 

12.  What  are  the  most  important  CLASSROOM  ROUTINES, 
PROCEDURES,   RULES  and  EXPECTATIONS  FOR  STUDENT 
BEHAVIOR  that  will  be  in  operation  during  the  observed 
lesson  (e.g.,  collecting  papers,  reviewing  homework, 
safety  precautions)? 

13.  Are  there  any  CIRCUMSTANCES  that  the  assessor  should 
be  aware  of  in  order  to  understand  what  will  occur 
during  the  scheduled  observation  (e.g.,  use  of 
schoolwide  discipline,  schoolwide  policies, 
interruptions,  behavior  patterns  of  certain  students)? 
If  so,  please  explain. 

14.  In  the  space  below,  please  provide  a  simple  SKETCH  of 
the  arrangement  of  the  instructional  space  for  this 
lesson  (e.g.,  student  desks,  teacher  desk,  student  work 
space,  arrangement  of  playing  field  or  laboratory) . 
Please  attach  a  SEATING  CHART  with  the  students' 
names,  if  available,  or  a  LIST  of  students  for  the  class 
to  be  observed. 


APPENDIX  I 
INSTRUCTIONAL  PROFILE 


The  following  are  questions  to  be  completed  by  the 
participant  of  the  study. 

1.  What  are  your  GOALS  for  student  learning  for  this  class 
period?   In  other  words,  what  changes  do  you  hope  will 
occur  in  the  students  as  a  result  of  this  class  period? 
Include  learning  goals  in  any  domain  that  is  relevant  to 
the  lesson  (e.g.,  academic,  social,  affective, 
cognitive,  aesthetic,  and/or  psychomotor  goals). 

2.  Where  appropriate  in  PLANNING  THIS  LESSON,  how  have 
you  used  or  accommodated  the  diverse  experiences, 
related  to  the  categories  listed  below,  that  your 
students  bring  to  class? 

a .  Gender 

b.  Race/ethnicity 

c.  English  language  proficiency 

d.  Economic  status 

e.  Skill  level 

f.  Exceptionalities 

3 .  How  does  the  CONTENT  of  this  lesson  build  on  what  has 
been  learned  PREVIOUSLY? 

4.  How  does  the  CONTENT  of  this  lesson  relate  to  what 
students  will  be  learning  in  the  FUTURE? 
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5.  What  teaching  METHODS  have  you  selected  to  help  you 
achieve  your  learning  goals  (e.g.,  teacher  presentation, 
peer  teaching,  programmed  instruction,  etc.)? 

6.  What  learning  ACTIVITIES  have  you  planned  for  this 
class  (e.g.,  game  to  learn  map  skills,  drawing  the 
action  in  a  story,  quiz,  etc.)?  Briefly  outline  the 
sequence  of  activities  and  indicate  approximately  how 
much  time  you  plan  to  spend  on  each. 

7.  What  instructional  MATERIALS,  if  any,  will  you  use  to 
help  your  students  reach  the  specified  learning  goals? 
If  appropriate,  please  STAPLE  to  this  form  a  copy  of 
any  student  MATERIALS  you  plan  to  use  with  this  class 
(e.g.,  map,  vocabulary  list,  questions  to  be  answered, 
printed  instructions,  homework) . 

8.  If  you  will  be  GROUPING  students  for  this  class  period, 
please  provide  the  following  information. 

a.  Group  name  or  number,  number  of  students,  and  basis 
for  group  membership 

b.  Is  this  a  TYPICAL  grouping  pattern  for  this  class? 
If  not,  please  explain. 

9.  How  will  you  know  that  the  students  have  learned  what 
you  intended  them  to  learn?   If  appropriate,  please 
STAPLE  to  this  form  a  copy  of  your  EVALUATION  PLAN  or 
INSTRUMENT  (e.g.,  a  list  of  oral  questions,  written 
quiz,  student  demonstration  of  a  skill,  or  any  other 
evaluation  strategy  you  plan  to  use) . 


APPENDIX  J 
PREOBSERVATION  INTERVIEW 


Questions  to  be  asked  during  the  preobservation  interview: 

1.  I've  reviewed  your  CLASS  and  INSTRUCTION  profiles. 
Please  take  a  few  moments  to  look  them  over  and  tell  me 
if  there  have  been  any  changes  in  these  since  you 
completed  them. 

2.  Why  have  you  chosen  these  GOALS? 

3.  How  do  the  connections  between  this  lesson,  past 
learning,  and  future  learning  reflect  the  ORGANIZATION 
of  the  SUBJECT  or  DISCIPLINE  as  a  whole? 

4a.   What  PRIOR  KNOWLEDGE  and  SKILLS  do  students  need  in 

order  to  be  successful  in  reaching  the  goal(s)  of  the 

lesson? 
4b.   How  do  you  become  FAMILIAR  with  the  PRIOR  KNOWLEDGE 

and  SKILLS  your  students  bring  to  this  and  other 

lessons? 
5a.   How  do  you  become  FAMILIAR  with  your  students' 

CULTURAL  RESOURCES  (e.g.,  experiences  outside  of 

school,  approaches  to  learning,  styles  of  interacting 

and  relating) ? 
5b.   How  does  this  lesson  accommodate  and  use  your  students' 

CULTURAL   RESOURCES? 
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5c.   Why  are  the  accommodations  you  have  made  IMPORTANT  to 
student  learning? 

6.  Why  have  you  chosen  these  TEACHING  METHODS? 

7 .  Why  have  you  chosen  these  particular  learning 
ACTIVITIES? 

8.  Why  have  you  chosen  these  INSTRUCTIONAL  MATERIALS? 
9a.   Why  have  you  chosen  to  EVALUATE  student  learning  using 

the  strategies  you've  described? 
9b.   If  student  outcomes  are  not  going  to  be  evaluated  today, 
when  will  this  occur? 


APPENDIX  K 
POSTOBSERVATION  INTERVIEW 


Questions  to  be  asked  during  the  postobservation  interview: 
la.   In  light  of  your  INSTRUCTIONAL  GOALS,  how  do  you 

think  the  lesson  went? 
lb.   Did  the  students  learn  what  you  wanted  them  to  learn? 

How  do  you  know  that  the  students  learned  or  did  not 

learn  what  you  wanted  them  to  learn? 
lc.   Were  the  teaching  METHODS  effective?   How  do  you  know 

they  were  or  were  not  effective? 
Id.   Were  the  ACTIVITIES  you  used  helpful?   How  do  you  know 

they  were  or  were  not  helpful? 
le.   Were  the  MATERIALS  you  used  helpful?   How  do  you  know 

they  were  or  were  not  helpful? 
2 .    Did  you  DEPART  from  anything  you  had  planned  to  do 

during  this  class  period?   If  so,  when  and  why? 
3a.   If  you  could  teach  this  class  period  over  again  to  the 

same  class:   What  would  you  do  DIFFERENTLY?   Why? 
3b.   If  you  could  teach  this  class  period  over  again  to  the 

same  class:   What  would  you  do  the  SAME?   Why? 
4.    Based  on  what  happened  today,  what  do  you  plan  to  do 

NEXT  with  this  class? 
5a.   How  do  you  think  (a  child  who  appeared  to  be  doing  well) 

performed  today? 
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5b.   How  do  you  account  for  this  performance? 

5c.   What  might  you  try  in  the  future  with  (the  child)? 

6a.   How  do  you  think  (a  child  who  appeared  to  be  having 

problems)  performed  today? 
6b.   How  do  you  account  for  this  performance? 
6c.   What  might  you  try  in  the  future  with  (the  child)? 

7.  When  you  need  ASSISTANCE  with  your  teaching  skills,  or 
when  you  have  PROBLEMS  with  a  particular  student,  whom 
do  you  talk  with? 

8 .  Do  you  COORDINATE  learning  activities  with  other 
teachers?   If  so,  why  and  how? 

9a.   What  forms  of  COMMUNICATION  do  you  use  with  the 

PARENTS  OR  GUARDIANS  of  the  students  in  this  class? 
9b.   How  and  under  what  conditions  do  you  use  them? 

10.  Is  there  ANYTHING  ELSE  you  feel  I  should  know  about 
today's  lesson? 

11.  I  have  several  questions  about  the  lesson. 
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